There is no shame in backing down in poundage, when the time comes I'll cheerfully back down. I'm not shooting all that heavy a bow now, but have no qualms about backing down.
45-50 lbs with matched arrows is plenty for deer.
When I ordered my Blacktail elite several years ago & we'd gotten the woods & draw length out of the way Norm asked what weight I wanted. I'd been shooting a Martin X200 @ 50lb & could dominate it. I told Norm that & told him I had no plans to ever hunt Elk or Bear & thought 55 lbs would be plenty. I could tell by his tone of voice over the phone he was dreading me saying 70lbs or similar weight, He immediatly said pfhhttt, 55 will handle that, & I could hear relief in his voice. ( it came in at 56 & is very sweet) Then I moved to Montana & the Elk situation changed.
Frank