Excellent point, and also why I prefer TDA 3rd Gens over any other setup. It gives you the most options, and also provides the safest way to both carry and load/unload with a very secure safety in place. I carry 95% of the time with the safety engaged, and like yourself am totally used to it and expect it. I can always flip an ambi-safety off through my cover garments in a pinch.
Realistically, how I look at it is that if you CC, then there are 2 dangers you face daily: 1) A threat requiring a Defensive Gun Use, which is highly unlikely for most people; and, 2) The possibility of an Accidental Discharge, which you carry with you every time you carry a loaded gun, to some degree or another.
S&W 3rd Gens in TDA simply make me feel the safest about carrying a gun from day to day. And they happen to be fun to collect.