hi, Scout!
Congratulations on having a FINE rifle! I've examined a Traditional Hunter in .454 Casull Magnum, and it's BEAUTIFUL!!!
As for your question on point of impact, your friend is right.
The same principle applies for pistols and light weight carbines. Higher velocity, lighter-weight bullets (Blazer) will impact LOWER than the lower-velocity, heavier bullet (PMC) ammunition. The faster, light bullet exits the muzzle in less time than the slower, heavier bullet during the recoil.
This principle can be used to advantage in regulating bullet strike on a fixed-sight gun. By simply adjusting the powder charge and/or bullet weight, the shooter can almost walk the bullet impact on target at will.
Good shooting to you!