There are only a few things that cause vertical stringing. As Castaway eluded, check your scope mount and make sure all the screws are tight. Open sights can jar too. If that doesn't fix it, you might be holding the gun different with each shot. Recoil (and that one will certainly produce some) will cause the gun to reposition in your hand and shoot to a different POI. I like to lay my heavy hitters down after each shot, then pick it up again and position it in my hand. The last thing would be your loads. If your powder charge, bullet depth, or crimp is inconsistent, the velocity will change and vertical string the shots.
I'd put my money on an inconsistent hold.