All good points from Graybeard. Also the unspoken one about needing a high quality scope to start with. With all of the rezeroing you will need a repeatable scope. Will 4 clicks up ALWAYS be 1 inch at 100 yards?
I swapped a scope between two rifles once......the scope base is the problem. Weaver bases allow for removing a scope but there is no standard distance between rings. Picatinny rails solve this problem with standard dimensions, but they are expensive and are not available for every rifle.