I am trying to install a sling adapter which requires removal of the castle nut on the lower. Thing is pinned in and wont budge. Did S&W intend for this not to be removed? Any thoughts on how to do this other than brute force? I have the special wrench for this...would hitting it with a hammer (the wrench not the gun) cause any damage to the gun itself? Thanks for any help you may have....