Underlugs have been known to set back, H&R replaces the barrels when they do that, it's not limited to the 500 tho, it's happened on other high pressure chamberings. I seriously don't think the frames stretch, but the action does have flex internally, likely at the latch pin since it's not supported close to the latch, just on the ends.
Tim