Well, I guess it would...the first time.
Basically, as long as the aircraft is flying faster than the speed of sound (mach) it is dragging a cone of disturbed air. As that cone passes you on the ground, you hear a boom. It sounds like an explosion. The very first time it happened they thought the aircraft had exploded in air. The Bell X-1 was a rocket after all so that was a real possibility.
I don't jump anymore. Here at Edwards we have our own air space. We have a super sonic corridor that our pilots can use at their discretion. Sonic booms are very common here. So common in fact, we sometimes have to reset the fluorescent light bulbs because the vibration can cause them to rattle loose.
However, it is very expensive to fly at those speeds. Only the F-22 can fly super sonic without using the after burner. Even so, when flying at that speed, they are burning fuel at an alarming rate. I was sitting in a T-38 for an engine test. We ran in full after burner for about 3 minutes. I could literally watch the fuel gauge drop because we were burning about 10lbs of fuel a second.

That plane can just barely go super sonic.