Hankster,
I swap three barrels around, without much poi change at all. I might just be lucky, but here's what I've done:
Muzzleloader w/synthetic forend I glued a couple of nylon washers to the base of the studs on the forearm. I sanded out the forearm and the 'ears' so that there was no contact. I have to be careful that the forearm is 'centered' when I tighten the screws down, and I always tighten them in the same order.
25-06 Prohunter w/synthetic forearm - I made my own pillars from aluminum because it didn't seem like the metal squeezing plastic was holding torque. Sanded for clearance just like the muzzleloader. Also careful to center and torque in the same order.
.223 Bergara 26" heavyweight-- the Prohunter synthetic is a push-snug almost snap-on fit on the barrel, and I sanded the ears for clearance. This is a different forend than the one I use on the 25-06.
Torque in identical order, too.
The last thing is my hinge pin has printing on it on one end (!), I always grease it and the holes up, then orient the printing to the same side and turned the same way.When I drive the pin in, I always take it past where it should be just a bit, and then center it driving it back.
So I might be lucky, but I think doing everything consistently helps, too.
I gotta go back and read, not sure if you said your stocks were wood or synthetic.
Wallypedal