Ted ol bud, I'll tellya wut! Before you change the sight, change your ammo. That Remington stuff bites the - ummm, er, par'n me - it is, shall we say, somewhat underpowered for the caliber. The American factory loadings of many european calibers are very underpowered in comparison to European loadings at original specifications. American ammo makers used liability concerns as a basis to load down European calibers in favor of American calibers. Ammo makers cited the use and prevalence of 'older military actions' as a basis for concern while knowing full well those actions were sound.
Anywho, get some Sellier and Bellot, or some PRVI. Both come in ball and hunting loads and are pretty inexpensive. With the S&B you will be shooting an 8mm round as it was originally loaded - a 195-200 gn bullet at 2500'/sec +, not a 170 gn round nose at 2300'/sec; significant difference. You may not need a sight adjustment with proper ammo; or you may, but at least you're shooting decent loads that are quite capable of taking a big buck out to 300 yds, if you are.................... Mikey.