Where the latch bears on the lug, after many shots slight 'brinelling' (shiny marks) will be visible. This reveals the status of the mate-up of the latch and lug. Two of my three Handi's showed off-center 'brinelling' which results in poor accuracy (with the fore-end removed). It is well known that, if a Handi won't shoot accurately with the fore-end off, it will not likely ever shoot well. What I have been doing after each range session is LIGHTLY stoning the lug to move the 'brinelling' so that it becomes even across the entire lug width. After light stoning I re-blue the lug surface so that firing the gun again will 're-brinell' the surface and show the new status of the mating surfaces. Slowly my 204 and 223 are getting closer to the ideal situation. MY Hornet was even across the width of the lug from the get-go and it shoots great with the fore-end off. I suspect that the more powerful calibers will mate-up with fewer firings.
Hope this helps someone.
Mc