The bigger issue is that modern "tactical" thought has been cultish in an increasing amount since the 1980's. Owning a 45 wasn't just a potentially non optimal choice, there were scum of the earth who had not converted to the Cult of 9mm. Heretics to be hated and chased down until there was Only One. This mentality has only grown worse as those with influence want to control everything, from language to culture, and obsess about it.
You are begging the question. We have given many good answers on why not. And, the problem usually comes back to, the proponents simply fall back into cultish mantras and refuse to believe there even is an answer. They just ignore and repeat the mantra until they win, as if there is no other answer.
Even when an explanation that is valid and right is given, it is simply ignored and "why not just do as we say" is given yet again. Red dots, bull pups, short barrels on rifles that should not be short barreled for the purpose, weapon lights, ect. Even when they are the wrong choice, the proponents simply come back with "but why not" as if no reply was given.
The problem from what I've seen isn't the people without accessories attacking the people with them, but radically the other way around. Carry a steel frame auto loader, a revolver, the wrong type of plastic frame auto loader, carry a superior rifle to the mediocre AR15, choose a caliber beyond The Chosen Calibers, don't put a red dot on your pistol, don't put a flashlight on your pistol, the Cult has it out for you.
Whatever is decreed the Current Conventional Wisdom shall not be tolerated.
The people saying "you can point your gun at someone out in public to identify them as a conceal carry without directly pointing your gun at them, so everything will be cool" in the thread are the worst. Try it and see how it turns out.