Yes, you do need some .22 rifles! Everything mentioned so far is a great choice.
I own semi-autos, pumps, levers and single shot .22's, but my preference is bolt actions. The Kimber of Oregon 82's and Remington 5XX series are nice rifles that shoot really well. Here's a few of mine.
The bottom rifle on this rack is an 82B Super America.
The bottom rifle in this case is a Remington 541S.
Custom Stocked 541S
Remington 514T Matchmaster