So much advice all over the place on here.
Do you want to own cool guns, or be a good shot? Or, both? You absolutely have the budget, though becoming a good shot will obviously require more than just hard cash on the barrelhead.
I know of gunsmiths I can out-shoot. But they can do things I cannot.
I know of collectors I can out-shoot. But they have nicer, rarer guns.
I'm not bragging...these are people who have chosen to place their expertise and money in other areas. It sounds like you want to be a shooter.
It's never too late if you're committed enough. I think of Paul Newman and his commitment to racing in late middle age. Most men his age and with his money would have become collectors. But he started at the shallow end of the pool, took his knocks, and worked his way up until people had to take him seriously.
Moral of the story: Don't dabble. Don't get a nice AR and a couple handguns, go to the local range once a month and pop off a box or two and think you're pushing the envelope in any way. Get training, surround yourself with better shooters who will push you, and practice as much as you can, especially early on. Once that good training is ingrained, dry-fire/handle/run scenarios at home. Be a "gun nut" for a while, as long as you can. If you end up drifting into other hobbies/pursuits, fine, but come back around from time to time to maintain your skills. Personal first-hand experience, it SUCKS to take a multi-year break and come to find that your muscle memory is long gone and you're barely faster & more accurate than the people who just got into it.