The barrel release button should be loose when the barrel is locked up and tight, that's normal, it should be fairly tight when the barrel is open, no looseness. See the barrel fitting info in the FAQs, it tells how to check latch engagement. Read the Handi 101 too, you may just not be closing the action firm enough, as always, read the owner's manual, it addresses that issue.
Tim