The group size and location is the exact same at 20, 25, and 30 grains of powder in my 1858. It's the same gun you have.
I measure mine each time. It really does slow the loading time time down quite a bit though compared to eyeballing it. I would hate to put too much powder in it, think I can still get the ball down, and then find out I can't.
I'd measure