I agree that a loose barrel when open is a little unsettling. It gives me the feeling of being cheap...but I also think that if it locks up tight, Handi rifles shoot better when the barrel is loose when open. As long as it is shooting good, do not do any thing to it. You will get used to it as long as it shoots good.
Good Luck and Good Shooting