Yeah, people talk, and they talk... but that is all they do.
I have gone back and forth from mag to special many times even in a day... shot the special enough, usually a hundred rounds or so, then switched to the mags, and yes, after that much, you can feel the extraction is a little gritty, but that is about it. Your gun won't give a hoot. You would be having to shoot some pretty damn dirty ammunition to have any real seating or extraction problems.