Best bet for your rifle with the least cash outlay would be to remove the A3 front sight base, and install one for an earlier M1903. Then, get one of the Lyman 17A's that are made to fit that dovetail, and is locked in with a set screw in the front of the base, just like the original '03 front sight is.
I've used that setup on a couple of target setups and hunting rifles, and it works just fine, no issues with being loose, and it's easy to use an original rear sight with that height, if you need to.