All good suggestions, and
Are you placing the buttpad in exactly the same position on your shoulder?
Are you sitting properly oriented to the table with your body position and elbows exactly the same?
Are you leaning into the gun exactly the same?
These things affect the recoil impulse, as transmitted to you, and if they are different the gun 'climbs' differently.
Yes, even with .22 RFs. With enough scope you can see the change in point of impact on target as directly relates to the way the gun felt as it went off. The POI becomes predictable to the little changes in hold as variations from a straight back recoil, when all is good. A summer (and about 3-4 mornings a week) with a 20X on a target gun at 50yd. taught me a lot.