I usually unscrew the grip screw a few turns and then gently push inward on the screw head. This will cause the opposite grip to move away from the frame. Continue this process until the grip lifts off. Then gently push on the inside of the remaining grip (through the frame) until it also lifts off. Do not pry on any edges of the grip.
I hope this helps. Steve