If the slide fits and dummies hand cycle through the action, it should cause no harm to the frame.

If your knowledge and experience has not given you the ability to look critically at the pieces; to fit, test, and dry fire them; and make the assessment without wondering if it will "damage the frame", then you shouldn't do it.

John