I have a Mag Pug that came with the rubber grips on it. They are hand filling and comfortable, but I don't really care for rubber grips for a CC gun. They are too "grippy", causing clothing to not slide over them, but tends to hang up everytime you stretch or bend over.
A couple of options would be to add a Tyler T-grip to your current grips, or get a set of aftermarket grips of wood or other material. I think Altamont Grips and handgungrips both have some models to fit the Charters. Another option is to find some factory wood Bulldog grips which used to come standard on the Bulldogs - you might check Numrich for a pair of those.