You might be talking about Barrow's, which is attached to a NAPA store. It's in Butler which is 1.5 hours or so south of Atlanta. I don't know of any north of the city that match that description. If there is one I'd like to know about it.
Barrows might be the best store in the state. Member Redlevel is very familiar with it. It'd be worth a trip if you have the time. Find Butler on the map. It's a small town and you'll find the store.
In my opinion there are very few even decent stores in the metro area, at least for the kind of stuff most at this site like.
Chuck's in Buckhead has high end shotguns and rifles, and occasionally has some nice revolvers. I've actually gotten some good deals there, one in particular was a Colt SAA.
David's Gun Room in Norcross is worth a look if you're in the area.