You have such a big chamber because the make of the mortar doesn't know what he is doing.
The total over all depth of the chamber of a full size Federal pattern 24PDR-5.82" bore Coehorn is only 4.25 inches.
Scale that down to Golf Ball scale the powder chamber would only be 1.3 inches deep.
By the way, cannons and mortars don't have pockets, shirts and trouser do. Mortars and cannons have chambers. So if you see a maker saying his cannons or mortars have pockets let that be an additional clue that they don't know what they are doing .