If you have to pull your gun out hearing loss is the least of your worries.

BTW the most anti social handgun I have ever been around was the Ruger .30 Carbine Blackhawk. It was soundly above the pain threshold even if you backed off 25-30 yards. Incredibly uncomfortable to shoot with hearing protection.