Never casted minnies, closest was maxiballs, so can only suggest from experience with the maxiballs when I first started casting them decades ago and I had similar problems, FWIW.
Possibilities... a temperature problem with the mold blocks themselves, dirty mold blocks, or impurities in the lead (dross, etc) might be worth checking out.