That certainly happens sometimes. I remember once seeing a decently dressed gent in upper New York State carrying a gun which showed (to me). It didn't bother me, and I wasn't taking a poll about other folks' reactions. He might have been a policeman or some such, but I didn't see a badge.Maybe people saw it and they didn't care?
FWIW, I often wear a "shoot-me-first" vest, and don't get a reaction. I once saw front-worn fanny packs which I well knew carried guns, because they were worn by co-workers of my "corrections officer" son. I'm not sure that he had them figured as armed.
Nothing wrong with being careful, but we are far more concerned about tell-tale clothing than the general public, or even most cops.