The latch is the weak point, not the frame. Yes, you can easily loosen one with the wrong ammunition. My Frontier loosened with just a few rounds loaded with a moderate load of Bullseye. It was tight and got just loose enough to notice the slight shake. I have shot hundreds of full power black powder loads after that with no additional problem. When it was re-Nickeled the plating was sufficient to tighten it up again. As I said, it was just perceptible that it was loose.
This is not the reason for a large B-C gap. Black powder is erosive and the gap will, very literally, burn out over time. Every Smith I have seen that had been shot extensively with black powder loads has exhibited erosion of the barrel breech and cylinder face, as well as flame cutting of the top strap. This applies to both top breaks and hand ejectors.