Gun design is a factor. Like Jim said, the Contender can do a number on you. A buddy of mine had one when we were stationed in CA. I made him some nice-shooting "mid-range" loads and some "barnburners" as he liked to call them. This particular gun was a 10" .44 magnum. I don't know what possessed him to do this, but he absentmindedly dumped the light loads in with the heavy loads. It was kind of funny, and at the same time rather annoying. We just figured we'd better shoot them up so as not to run into problems later. This gun would recoil so hard that the rear of the trigger guard would injure your middle finger. In a better designed gun, these loads would not have caused as much distraction.
The next biggest factor might be your expectation of getting hurt. Douglas MacArthur coined the phrase, "The anticipation is greater than the realization." Maybe he plagarized it but it rings true when shooting. If you look at another shooter firing a hard kicking handgun, notice the total movement of the gun. It just doesn't amount to much. Grip the gun firmly, press the trigger and let the gun do what it's going to do. It will kick and move the same amount whether you are tense & nervous or calm & relaxed. Choosing the latter, the difference will be that, one, you will enjoy the shooting much more and, two, your bullet will likely be free of the barrel before you are able to jerk the sights out of alignment with the target. The discharge should surprise you. You should not attempt to control exactly when the gun will fire in less than emergent situations. Obviously if a lion is flying through the air with the intention of eating you, it's appropriate to maybe put up a wall of lead. In nearly all other instances you would probably do better to focus on breath control, relaxing, aiming/sight alignment and finally, squeezing the trigger. The gun will fire but that is not your prime concern. Focus on the other things I mentioned and your bullet will cut through the target before you know what happened.
Once in a while you run across someone who knows someone who stuck their face up too close to the rear of a 1911 slide or shot a rifle with their eye pressing against the occular lens of the scope. This is rare. Most shooters don't get injured by firing their guns. Just recognize the recoil and muzzle blast for what it is and that doesn't amount to much. We take harder hits playing basketball and backyard football.
Paul