A Sportsmans Permit or LTCF isn't needed if you walk from your home to your hunting spot and DO NOT conceal the gun.
A SP or LTCF is only needed if you conceal the handgun or transport it in a vehicle.
Manually operated handguns are legal for hunting so long as you abide by the centerfire/rimfire rules for certain game - so no stamps are needed. The only issue is carrying/transporting of a handgun. If carried openly and you never get in/on a vehicle - no license/permit is needed.
The Sportsmans Permit is only $6 or $7 and issued by the county treasurer. It is only good during hunting, fishing, trapping, and dog training. The LTCF is $20, issued by the Sheriff, requires a background check, and is good for all lawful purposes. No reason not to get the LTCF really.. ...its a get out of jail free card just incase you accidentally transport your handguns if you're the type that doesn't carry for protection.