I'm an avid caller/rattler, given that certain conditions have been met. I do some blind calling just about every time I hunt, and it has accounted for the deer that's on my home page plus another 140-class buck that's hanging on my wall. It was during the rut both times, both deer responding to aggressive grunting and both deer came in with that PO'd look like they were getting ready to whip someone's @$$.
However, for me to do any type of calling, a few conditions have to be met.
First, if I'm just looking to get a deer, with no regard to sex, size, or maturity, I don't call any at all. Using a grunt call can easily scare off smaller bucks and does, and using doe in estrous bleats can easily scare off non-estrous does. If you're looking for the dominant buck (as I often am) and don't care what other deer you may potentially scare away, then it's time to try calling/rattling.
Secondly, what calls you use depends on the time of year. Obviously if you try aggressive grunting, rattling or estrous bleats during a time when the rut isn't even close to being in, then you'll probably scare away most of the deer in the area except for maybe a curious doe. Make sure you are using a type of call that suits the time of year.