Is easy to do - just remove the grip screw and then pull the panels off the grip frame.
My recommendations:
1) Use a screwdriver that fits the grip screw properly so you don't mar the screw.
2) If you can't easily pull the panels off, pry one off gently from the bottom with something thin that...