File for elevation, like mcwoodduck said. The correct way to change windage would be to make a wood barrel block, put it in a vise, make a witness scribe, then slightly turn the barrel, although you are already pretty close, and I would be concerned about damaging the aluminum frame. An easier option would be to slightly bend the front sight with a pair of padded vise grips. I am assuming it is not a dove tailed front sight, if I remember right. S/A's can be very grip sensitive. You might try resting your thumb on the left recoil shield. It might bring your groups to the right a little.
Larry