At high velocities there is deviation from the optimum angle being 45 degrees. At lower velocities it is very close to 45 degrees.
It all boils down to "does a wooden ball ball as fast as a lead ball when dropped from the leaning tower of pizza?". Rumor has it that they do.
Eventually, if the velocity became high enough, air resistance would slow down the lighter ball. If the velocity is high enough that air resistance slows down a heavy lead (or whatever) ball, then a lower angle will get you further.
When shooting a mortar 100 yards at 45 degrees, the muzzle velocity is something like 200 feet per second. At peak altitude (50 feet), the velocity is only about 141 feet/sec. At impact, it would be back up to just about 200 feet/sec.... overall a pretty slow round.
I guess in the civil war they were shootin alot further than 100 yards, so the muzzle velocity would have been alot faster, and air resistance would have become fairly significant.