In theory even that makes a difference. In practice I have found that that makes far less difference than other variables. The scope does in fact stay with the barrel, it is the difference between the barrel and receiver that changes from shot to shot. In practice, in the field, you lean against a tree, over a rock or limb, over a coat on a pickup rack etc. I am not going to be shooting just by laying the gun on a bag, I HAVE to have a grip on that forearm, and that pressure both down and to whichever side I am resting against effects accuracy in the field. The ONLY place IMHO that this really matters is when working up and deciding on a load. Most of my loads for the large calibers seem to stay around 1.5" at 75 yards on my handgun/ cast range, from sandbags etc. That is how I pick the load to use.
Once I have the load, if I really want to see how it performs, I will grab the gun, trot outside and shoot at a standard 2 pound coffee can or 2 liter soda bottle at from 50 to 100 yards, each time from a cold barrel, with a left side support, right support, over a limb or fence rail. If you can be confident of a solid hit on that coffee can first time, every time, in various light , wind and temperature, and rests, you are good to go for hunting at that range. It is nice to have a tack driver, but how often do you hunt tacks.
PS....... cleaning is something handis are picky about....... they seem to object