never. i have a 22 rifle that i never cleaned and it shot great. i cleaned it one day and my accuracy went all to hell. it took a half box of shells before it shot good again. when i cleaned it, i saw no evidence of damage from not cleaning it, and since it shoots best dirty, i wipe the barrel down and put it away without cleaning inside the bore.
-Matt