When I am removing the tie rod end from the steering knuckle, using a two-jaw gear puller, sometimes I reach a point where I can't turn it any more, so I wack the joint between two hammers, and it pops apart.

Could you tap the screw end of the sight pusher with a hammer, to dislodge the sight? Or is that not recommended?