They make tools for removing the stuck brass from the dies.
One locks to the extractor ring on the base of the shell. I'm surprised that you didn't break anything.
If you have a friend that is a old time reloader - maybe you could call them on the phone and ask for assistance. Most will already have the tools to remove the brass from the die.
You can also call your press manufacturer and they will sell you the tools to easily and safely remove the shell from the die.
If you punch it out and scratch the bore on the inside of the die, it will probably ruin the die or cause more damage to it than what it is worth.
You have to remember that your die is a precision instrument and heat and cold will shrink or swell the OD and ID of the die, once that happens - it will not be precision anymore.