I had the same experience as the OP at a young age while hunting and again when I was much older while camping.

I think we have a 6th sense that we automatically tune into. And since we're not used to doing so, it scares us when we do.

Both times I was armed to the teeth and glad I was!