Some folks go out and purchase a belt sander...
But that's too much work..
And there isn't much left of the grips either.
Really, it depends on the wood's damage and finish.
I believe that these grips made by Herrett had a light clear coat or something similar- not oil finished, so...
Do exactly as OCD1 says. The only thing I'll suggest is if you want to give these grips an oil finish instead of any kind of clear coat, most oils will darken the wood- depending upon the kind of oil, and each oil has specific instructions and be careful to dispose of the oily rags properly as they are spontaneously combustible if thrown away carelessly!