I seem to remember reading something somewhere (maybe here) about using pencil lead to detail very light rust.
So when I picked up a 1917 vintage M&P last week with maybe 50% finish remaining, I decided to try it. Maybe a bit of an innovation here, I tried using one of those cheap plastic disposable mechanical pencils.
I think they use a combination of polymer and graphite for the 'lead'. Turns out it worked great to clean off the light rust patina (I'm not talking about pits) you often see. The graphite is softer than blued steel, but harder than rust - and you have near pinpoint accuracy.
Go to the dollar store an pick up a pair of 2, 2.25, 2.5X reader glasses (whatever suits your own particular focal length), and start dithering the rust off.
I have tried many non-abrasive techniques and I believe this works the best. The lead will break often, but these pencils come in 10 packs - cheap.
Recommend you look for the all-plastic ones. The ones with a metal lead guide at the bottom work fine too, just the idea of working with metal so close to your firearm points me toward the all plastic version.
The graphite that's deposited on the gun wipes off easily and leaves bare steel. Much better to my eye to have spots of bare steel on the blued surface than rust. Changes 'neglect' to 'maintained', but retains the honestly-won patina.
Try it...I think you'll like it.
For pits...I use one of those needle-in-a-dowel probe tools from an old dissection kit. This will certainly scratch a finished surface so be careful, but down in a pit it does no damage and gets rid of the iron oxide - ready for wax or you own preferred preservative coating.