While that may be true, in it's own right, it still makes it hard to practice with a rifle that shoots off after the first round. In a shooting session I like to fire off many rounds, in different positions. You never know what position you will be in out in the field. So in this case, and if it where my rifle, I would try to get this corrected as much as possible. That is unless you are already completely comfortable with it...though it's hard to get this way without practice and time spent with it.
It's true and I agree the first shot counts.
Like Tim said, try different forearm pressure points, O-ring, shim behind the forearms spacer, and if it comes to it bedding.
SS also has a good point, as he usually does. It's a great site with tons of useful info.
-Aaron