Ditto to what Stimpylu says. Go to the library before you spend ANY money. When I started, I thought, "why not buy the manual, I will always use it as reference." That is a good way to waste some money. Everyone has a favorite, but I would look for the newest Lyman Manual #48, I think. Another bit of advice would be to buy the bullet maker's manual AFTER you decide on which bullets your rifle shoots best. I bought a Nosler manual and between 3 rifles only one shoots Nosler very well. $20 or $30 a whack adds up.
As long as I am looking back on my 2 years of reloading, I would say don't scrimp on the dies. I am not convinced that the press really matters other than personal preference. The Lee dies are okay, but by the time that you replace the fake lock rings that they send, then you haven't saved any money. The time that you waste fiddling with seating depth because you can't lock the seater on the seating die also leans me toward Hornady or RCBS dies. Between Lee, RCBS, and Hornady they all seem to have great customer service.
Last bit of advice: DON'T USE A LUBE PAD, BUY THE HORNADY ONE SHOT CASE LUBE IN SPRAY CAN. I cannot stress enough how much stress you will save by NOT using a lube pad. Maybe I was just a ham-handed idiot, but I dented a lot of cases and got really, really frustrated a couple of times.