I have two .17 HMR rifles, a CZ and a Ruger 77/17, much more accurate than the .22 rimfire LR, cleaner too, and kicks about the same as a .22 LR. But I also love my military rifles, even my hard kicking Mauser 98 in 8 MM offers a change from the small bores.
The nice thing about the variety is it makes life more interesting!