kynardsj, I had that same problem when I first started shooting single actions. I have smaller hands and found I was scooting my grip around to the right resulting in shooting high and left. When I made it a point to move my hand so my forearm was in line with the barrel or shot two handed, it shot to the sights. Check your grip. I used to grip it the wrong way so it was easier for my thumb to reach the hammer to cock it. That was solved by putting a SBH hammer in my Rugers. I still have a 'reach' problem with Colt style guns, but I love 'em anyway! 44 Man
As to the adjustable sights on a RV, I'd use that gun as is with a fun 'woods walk'n' load and buy another RBH with adjustable sights for my 'bear load'. It's cheaper that way and 2 guns are more fun that 1 gun that you have to keep moving the sights on for different loads. Just the way I'd do it.