Get the 30-06. My Handi 30-06 is one of the most accurate rifle (be it Handi or not) that I own.
The way I handle the "Mommy" question is that I offer to buy her something that costs as much at the new rifle, barrel, whatever. Yes, I know that the rifle, barrel, whatever costs me twice what the actual purchase price is, but what is domestic tranquility worth?
Plus, I get points for being a good guy and she brags to her girlfriends and they are jealous.
Win - win all around.