If anything, the j-frame guns are less likely to be damaged than the larger ones, as they employ coil springs. That is one secret of Ruger's durability, too.
However, I've never seen a broken leaf spring in the larger S&W guns.
You may break a firing pin or elongate the firing pin hole in the frame to an oval shape, but I've never personally seen that happen. The frame issue may have been more likely on older, softer frames? There is a bushing there for the pin, though. I think it's of hardened, tougher steel.
Maybe repeated impacts might affect an Airweight light alloy frame.
I have no experience with firing pins mounted in S&W frames. My guns have always had the pin on the hammer.