Let me start by saying that I am in no way interested in the newer "short magnums."
Now, since that is out of the way, I can talk about the kinds of rifle cartridges that have served "riflemen" well since the invention of smokeless powder.
.264 diameter bullets and the cartridges that employ them (6.5X55, .260 Remington, and even the 6.5-06/6.5-284 type "wildcats") have a lot to recommend them.
.257 and .277 diameter bullets (especially as employed by the .257 Roberts, .25-06 Remington, and .270 Winchester), although not as versatile as the .264 stuff, are also very good.
I feel confident that my 7mm Remington Magnum will capably do anything I will ever need a rifle to do.
So, I guess I would say that a good 7mm Remington Magnum, a relatively light and handy .260 Remington, 6.5X55, or .257 Roberts, and whatever kind of .223 Remington and .308 Winchester suits you are all that most "riflemen" will ever "need."
After those four, something like a 6.5-06/6.5-284, .270 Winchester, or .25-06 Remington is high on my "want" list.
Regardless of these preferences, I find that I have a subconcious "need" to have a good supply of loaded .223 Remington, .30-30 Winchester, and .308 Winchester ammunition on hand.