I just found this discussion and thought that I would add to it.
For me, it depends on the type of hunting that I will be doing.
Rifle deer, pig, Upland game, and jump shooting waterfowl are in my "street clothes", usually blue jeans/cargo pants and some form of shirt and jacket. I will add chaps and vest if appropriate.
Now If I am hunting Turkeys, Archery Deer/antelope, Calling Duck and goose or varmint calling, I will generally use camo. As one of the earlier posters said, my camo is more for differentiating my hunting clothes from my regular clothes.