I think there's quite a bit of difference between having a gun on your person for immediate use versus a gun somewhere in the house. But perhaps the most important reason, at least for me, is having the gun with me going in and out of the house. Disarming myself every time I enter the home means that I must arm myself again when walking out. I'm in and out quite a lot. I know how it works... end up walking out the house without the gun.... then rationalizing it's just to the mailbox, just a walk a few houses down the street, just a quick trip to the convenience store,... on and on.
My LCP carries unnoticed as does my wallet. There's simply no reason to disarm myself whether I'm snoozing on the couch, making a sandwich in the kitchen, reloading ammo downstairs in the shop or walking behind the lawnmower.