Since I didn't have a brass drift punch I used what I did have, a steel one. When I laid the barrel down on w board, on the concrete floor, I placed the punch on the left side (seen from the rear of the rifle) and gave it a good whack. It took two thumps of moderate pressure and it popped right loose.
Don't be afraid to use a steel drift punch. Brass may well do it, but mine was very tight AND glued in with something.