I see it this way, life is too short not to enjoy the things you want to. Every season you miss, is a season you'll never get back, and then it'll be just too late. When faced with the decision of either working at a crappy job(must be if you ain't hunting), or making some adjustment to live a better life....guess what I'd choose any day of the week?
Set your priorities, and everything else will fall into place!
Scott (JMHO) B