jl7030:
Could I ask a few questions without anyone taking offense? Are you an experienced hunter? If not, you are really handicapping yourself with your selection of tools, not mention making it hard on the game. What is "pretty good accuracy"? How far was the shot? Where do you feel you placed the shot? If you put into a shoulder or guts, I'm not surprised you lost it. Most experienced hunters will consider the Colt 45 a short range cartridge, and must have excellent shot placement, such as head or lungs.
The 45/410 Survivor was never designed as a deer tool, with its large jump from case to rifling. The 45 Colt is an excellent pistol round, but even out of a long gun the range is not greatly extended. And placement is alway critical.
Just my opinion, but I think you need to consider a more powerful tool for the welfare of the game animal.
Wally