A POI shift at different powers is a scope issuie and for long range , Yes , A scope not lined with the bore will effect how it shoots at further ranges , question is how far are you shooting and will this apply to you in any real world cases?
If so , I would suggest you zero it at your furtherest range you plan on shooting.
Your mileage will vary of course depending on just how far you are shooting and how much you scope is cross eyed