Honestly, it up to you. I am all about simplicity and keeping things uncomplicated. When something goes "bump" in the middle of the night I know I don't want to have to figure out what firearm to grab, should I need one. Currently, my bedside HD gun is is a Glock 19 with CT laser. On my wife's side of the bed she keeps a Shield 9mm. I am in the process of replacing my Glock with a full size M&P .40 (larger cal and 5 more rounds in the mag, not to mention better hand feel) but just got it and have not had any range time to feel comfortable using it for HD yet. All other guns, including the Shield .40 I use for CCW are locked in our large gun safe.
My point being keep it simple. If I were you and felt proficient with the FS .40, use it for your primary HD gun. No reason to get ride of the other guns if you like them. Just store them appropriately in a different location.