Well, I guess the 'good thing' is you seem to have a close chambered cylinder and accuracy always starts with that!
I have had more issues with 22 RF ammo regarding inconsistent and oversize lead bullets than ever before. The 22LR bulk packs are the worst offenders and with a close chamber gun I run the cartridges through my old Paco Kelly sizer. On a looser chambered gun these same unsized bullets load up fine. Ed Harris determined years ago, to my satisfaction, that the bullet fitting the throat closely on a RF is just as important to accuracy as in any CF. I cant help but wonder if a 22M sizer at .224 would cure your issue? (always something to mess about with in this game, isnt there.....)