Mil-spec barrels are made for long life and it would probably take you a lot of rounds - and I mean a lot - to wear out your barrel but that doesn't mean it will shoot any better for you than it would if it was lapped.
Lapping removes roughness and minor obstructions in the bore and allows the barrel to shoot or group more consistently and that makes lots of folk much happier with what they have rather than cursin' an inaccurate rifle.
The barrel making process, as I understand, is not the gentlest on the bore. The barrel blank is inspect for straightness, etc., then chambered and rifled. After it looks to be a 'within specs' barrel then it gets stamped and drilled and machined for its sights, name, caliber, slots, etc and all these procedures can create minor obstructions to the bore that interfere wiht good accuracy. Lapping helps remove those 'impurities' and in every case in which I have lapped a bore the accuracy has improved.
I would, again, suggest you visit Veral Smith's forum for more insights on lapping and also visit the Beartooth Bullets website for their informationon lapping. HTH. Mikey.