The drill press works fairly well for this. I hold the die in the vise, (little one that sits on the table, not held down) and chuck up on a split dowel or metal rod. Use 220 grit or so sandpaper to start, wrapped around the dowel to the right size. Run at moderate speed and hone up and down until you're close to where you want to be. To check the size clean the die well and either use gauge pins or run a bullet through it and mic it. Finish up with some 400 or so grit paper to make it a mirror, and they work a whole lot better than when they come out of the factory.
Pushers are another matter. The edge should be quite sharp, with about .002" less than the bore size so you don't get misformed bullet bases. The factory Lee ones are too soft and too small usually.
A case lube pad and RCBS case lube works quite well for sizing bullets. The lube is water soluble so it washes off after you size them. This avoids sticking bullets and smearing lead, and lets you size bullets a considerable amount in one pass if you need to.
