shepherm,
you might be able to stabilize your group sizes by free floating your barrel and dropping the load a bit. As close as it is to the max loading it is most likely being stabilaized by barrel contact and as the gun heats up, more pressure is applied to the barrel by the stock warping. If you remove all contact between the barrel and stock you may find that the groups are as large as 2 inches. When you drop the powder charge a bit it may settle down and relax the pulses of the barrel, bringing groups into a smaller one than you are getting now.