For Georgia, you may want to check out Stone Mountain. Some call it the Rushmore of the East. I can't remember how far from Atlanta it is however.
In South Carolina, Charleston is lovely with a couple of plantations and other historical houses open to tourists. Sweetgrass baskets made by the locals are one of the things sold to tourists and some of them are real works of art. You'll find less touristy prices if you drive along route 17 north, heading towards Myrtle Beach.
As for Myrtle Beach, I haven't been there in a VERY long time so I can't recommend it.
In North Carolina, if you are into kitsch check out South of the Border on rte 95 at the border of North and South Carolina. SotB has existed for at least 50 years in the same spot and is a bit of a tourist trap.
Also in North Carolina I would recommend The Biltmore in Asheville and Chimney Rock near Lake Lure. If you are into poetry, Carl Sanderberg's house is south of Asheville and is open to the public for tours. The blue ridge parkway also runs through there as well and you can find the NC arboretum and the arts and Crafts center on the parkway.
There are a TON of caves along rte 81 in Virginia - Lurray is the most famous of them. For a bit of fun, you can visit Foamhenge ! Also there are several civil war sites along the highway as well.
Can you tell I travel in the area a lot?
Good luck and have fun!