I use my mini-mill. I put masking tape on the vise jaws, tighten the slide in the vise, put a stud (usually an appropriate size drill bit - mounted upside down) in the chuck/collet, and use it to push sight in/out. You could probably use a drill press with a compound vise - if it is big enough to take the lateral stress (can be pretty heavy).