Something is too long with your reloads. Neck not sized enough, shoulder not bumped enough, high primers..... Take a fired brass from one of your reloads. Can you chamber it and make the hammer fall ok? Do you still have to slam the action shut?
On my rimmed cartridges, I take the barrel off of the frame. I take a fired brass and put it in the chamber and then hold a straight edge across the brass at the chamber end of the barrel. Usually, fired brass sticks up just a little. You can see air gaps and the straight edge will rock a little. This is due to the tolerances with the barrel, frame, hinge pin, etc.
Size the brass and try it again. You should be able to lay your straight edge across the chamber and not get any rocking. No air gaps. If the brass appears low i.e. a gap between straight edge and brass, you are sizing it too much.
You can check seated primers in the same way. Put a straight edge across the rim of the sized and primed cases. If the primer is high i.e. out too far, the straight edge will rock back and forth.
Good luck with that barrel.
You will be down to 1/2" groups soon!!
Steve