Sorry to hear about your first experience with the .500, there's another thread down the page by Ditchdigger on the same problem, check it out.
For the long range deer caliber, I'd opt for either the .25-06 or the .280 since they both come with 26" barrels, the .308 and .30-06 are both 22". If you think you might ever wanta elk hunt, the .280 would be the better choice of those 2.