Over the past 30+ yrs Ive had, in larger CF, 44spl & mag, 45Colt , friends with 38-40 and 44-40, and reloaded (or aided their reloading) for all. Their performance with typical cast lead bullet velocities, for practical use and fun shooting, does overlap more than a fair bit. I could be happy with any, but find the straight wall cases and carbide dies to be easier to live with for reloading. Looking through my notebook, my loads are surprisingly similar, regardless of caliber, with fine tuning of the load to get the desired POI to the sights if needed (by juggling bullet weight and/or powder charge).
My all round favorite, rifle or handgun, is 22LR. They always seem to be ready to go for a walk, etc. Yes, they have limitations, and if I knew I would be in a bad social situation that cal. would not be my choice, 12ga/OO autoloader or pump probably would be, along with Doc Holliday and the Earps.