It depends on the caliber and the load.
For full-charge smokeless, jacketed bullet rifle loads, USE NO FILLER!
For full charge pistol caliber jacketed and lead bullet loads, normally use NO filler.
For reduced charge lead bullet rifle loads, kapok dacron fiber was used. However, the American Rifle Technical Advisor has stopped recommending dacron fiber for this, as there have been some reports of "ringed" chamber and bore damage to rifles.
For BPCR blackpowder lead bullet loads, some shooters use cream of wheat cereal or cardboard wads to obtain a compressed load. Others use cotton ball tuffs. For BP loads, it's very important to get 100% load density.