BBF:
It has always come down to this: I can go to other countries or states and spend about the same amount of money and have a better time with fewer hassles. So that's what I do. Now that the Canadian dollar is high relative to the US dollar, Canada is the least attractive it's ever been.
The transport laws for fish have become a bit absurd too, so going to Ontario to fish is less and less attractive. There's no one thing that makes Canada unattractive, it's really a lot of little things that have turned me away.
For fishing, we catch more, better, and bigger fish elsewhere. For hunting, the options are better elsewhere too unless you have a fixation on something particular to Canada.