Polish it off. It's a few 10-thousanths" deep. You're only working on the part visible. Leave the area around the bolster that's inside the frame alone. That'll avoid any fitting issues and you can't see it anyway. I'tll do some good in that it allows lube to gather in the small depressions (it's original intent). I'd leave it alone on any internal parts like the rebound slide.

I'd hand polish it out. Start with something like 800grit backed with a fine file to keep things flat. If needed you may have to back down to 600 and then back up the 800 and then higher grit for more shine if that's what you want. Stay away from a Dremel or a buffer.