Yes go ahead, but be very careful not to remove too much material. You want to POLISH not FILE the bump out. I would drive out the pin that holds the locking bolts in, polish a little, put them back in and test. Repeat until you get it right.
I have polished the lugs on 3 or 4 barrels, especially older barrels, to get them to lock up properly on my G2 Contender. Just don't get carried away.