Another factor to consider, to dissuade you and others from hunting deer with a cap and ball revolver:
Most of the original revolvers have atrocious sights, a groove in the nose of the hammer or along the topstrap, and a brass bead or steel post up front.
Exceptions are, of course, the Ruger Old Army and the reproduction Remingtons with modern, adjustable sights.
Every Colt-type C&B revolver I've fired shoots high, often very high, at 25 yards. I have a repro Colt 1862 Pocket Model in .36 caliber that shoots dead-on at nearly 100 yards! But to do so, it hits about 10-12 inches high at 25 yards, from a benchrest.
My repro Remington .44 required filing down the front sight, a lick at a time, to bring the group UP. Yep, my repro Remingtons in .36 and .44 caliber both shot LOW but they had unusually high front sights. I believe the manufacturers (Pietta and Uberti) did this purposely, so shooters could adjust their sights to point of aim.
Original Remington C&B revolvers I've seen have front sights much shorter than modern repros, so I'd guess they probably shoot high too.
The Colt Walker may have the power for very close shots with conical bullets in expert hands, but the primitive sights bar its use.
To compensate for its relative lack of power, the cap and ball shooter has to place his shot very accurately at close range.
Cap and ball revolvers are marginal for deer, at best. If you want a blackpowder pistol hunting experience, use cartridge guns loaded with black powder or the single-shot pistol of .50 caliber or larger. Whichever, they must have good, accurate sights to place that crucial bullet EXACTLY where it's needed.