Hardly,
listen to Yankee. we have been doing exactly what you describe in smallbore and highpower rifle silhouette for about 30 years. a scope with quality tracking will come back to zero. we shoot 200, 300, 385, and 500 meters at a match. with sighting, practice, and match shots, we are cranking our scopes quite abit. not really a big deal.
dave