IMO not at all. I have seen B&C class bucks grazing within 2 or 3 yards of a recent hog kill site. Last season I killed a trophy buck standing 35 yards from where I shot a 200 lb. hog just four weeks prior.
Deer, like other wild animals, are very attuned to changes in their environment. They may well avoid a kill site the first few days afterwards (although I have seen them walk calmly right over a spot where a deer gut pile stood just 36 hours ago), but they will very quickly return to their normal routine when it becomes apparent that there is no immediate threat. Death of animals in a deer's world is routine, so I don't think they attach too much importance on where it happens, or else they would be quite restricted in movement in a very short time.
Much more damaging would be deer repeatedly sighting you on your stand or in the vicinity, or leaving repeated lingering odors that are distinctly human in the area.