Chief, I've posted this before so you may have seen it, but I took a class with John Correia, Active Self Protection (
https://activeselfprotection.com/our-owner-and-founder-john-correia/) a while ago. One of the things he said was that in reviewing nearly 50,000 civilian self defense shooting videos, they had yet to see one where the good guy defending himself reloaded.
(He noted there was one recent exception: A guy with a 1911 in Pakistan who shot two guys on a motorcycle who were trying to assassinate him. He reloaded when he had them both down, and fired once more into each of them.)
John said that he would never advise anyone not to carry a reload. He said he was simply saying that he believed they would never use it.
My take on this is that it is a question of risk tolerance. For myself, I am comfortable without carrying a reload, but I understand why others, especially a man as careful as yourself, are not.