Jess ...
I also had a four handicap several years ago when shoulder surgery forced me to give up a game I really enjoyed and could relax playing. I turned my interests more to firearms and then into reloading. For me, reloading is something that is challenging, tedious at times, very rewarding, and relaxing all rolled in to one package. In the past 16 months, I have had 3 more surgeries (none life threatening) on my right hand and back. It was an easy decision after shooting the .300wsm Win with a brake installed that I would not be able to continue the higher recoil calibers. This is why I do not have a Handi 45/70. Through trial and error, I found that I can manage recoil in the 7mm-08 but that was the maximum.
I guess the point of all this (and I know you full well know it) is that there are plenty of interests still available to you concerning firearms. If you do not reload, please try it ... you will love it. If you already reload, reload for family and maybe some good friends so they can maximize their rifles/handgun's potential. Maybe you could do a few trigger jobs for other people.
Again, good luck in whatever path you take ... you will still have your friends here.