With high rings, if you cant the rifle a little, it will shoot left or right depending on the amount of the cant and how far above the bore the scope is. Make sure the scope is properly aligned with the vertical axis of the rifle, if it's rotated slightly, it will compound the issue.
You can place a long straight edge along the side of the scope rail to see if it's aligned with the barrel. If all I mentioned checks out, removed one of the rings and rotate it 180º and remount. Make sure both rings are seated on the rail properly too.
Tim