I consolidated to 9mm once.
I used subsonic 147gr so I could shoot my M9 suppressed.
But, my HK PSP wasn't supposed to use 147gr, so I have some 124gr for it.
And them my EDC was a Kahr but the top round of the spare magazine kept working it way out. Sometimes it would just hang out there and have to be repositioned before the mag could be inserted, ot the spare round would come loose.

After time, I found myself with 2 flavors of 9mm, a couple of .45ACP, and some .38 Specials.

And then there were the rifles.

I am back down to 3 handgun calibers and one rifle caliber to reload. And I don't reload one of them because bulk 147gr 9mm used to be so cheap. We'll see about that some day.

So, go ahead and consolidate. It might work for a couple of years.