While GB is busy lobbying the legislature for handguns without scopes, his legislators are working tirelessly for scopes without handguns.
GB's real point, however, is well taken. I've taken the scope off my sainted 44 magnum in anticipation of my next pig hunt. I'll be going au natural (i.e. with factory iron sights) for that hunt. However, this is because I can be reasonably assured of multiple options for shots at reasonably close range, and in good light. When I hunt in the changeable dimness of the northern woods, I want the optics, unless I'm in a tree stand where I can be sure of a shot at archery distance.
If your handgun hunting is at archery distance, I think the scope may actually be a handicap, so long as you can see the iron sights reasonably well.