Here is the deal. You care too much. Stop caring and the buck fever goes away. Don't get it when you see the deer out the car window do you?
Now here is the tricky part. If you didn't care, you would not be hunting now would you? I suggest you shoot the next five deer that walk by, fawn, does, bucks whatever. Alternately try to shoot every deer that walks past. By that I mean get set up for the shot, let the adrennalin flow, try for the shakes, commit to the shot, draw the bow, pick a single hair, whisper bang then let the bow down.
When you do decide to shoot a deer, don't look at it too much. keep it in your peripheral vision but don't focus on it. Stay still of course but look for other deer, try to tell yourself the deer is nice but you would really like to find a bit bigger one right now, matter of fact it is too dang small. Convince yourself you are going to let it pass. Heck let it pass, maybe, or quickly change your mind, draw pick a hair and release.
Convince yourself you don't care.