Lots of people remove the extractor from their Encore Muzzle Loaders and really like it that way!
But, all it will take is one time for your primer to stick, to the point where you will need your knife to pry the primer out and you could see your deer going over the hill!
I took mine out and tried 4 or 5 primers (just the primer) and after the first one, the rest stuck and I had to pry them out!
So, I say "use the extractor"! But if your works good without an extractor, so much the better!