I have a 4506 from which I need to remove the right side safety lever. I've seen a video showing how to insert a pin into the small hole on the lever to depress the Safety Lever Plunger, but when I try that the lever will not slide off even with the plunger depressed. Is it necessary to remove or advance the firing pin to allow the plunger to fully depress?