Lee makes a good starter kit for around $75 bucks. That doesn't include any dies though. If you can't swing that and want to buy things out seperately, then you can get the following (for a press setup) as a MINIMUM:
1. A press. I know that Midway has the small Lee C-frame press for under $20.
2. A die set. You'll need one of these for each chambering you want to load for. To start with, I'd say Lee here (though once you get a bit more cash and some extra equipment I find Lyman dies to be a bit better of a value IMHO). The Lee dies run ~$20 and they come with a shellholder and powder scoops, as well as some basic reloading data. This stuff normally doesn't come with other brands.
3. A priming tool. A Lee Ram Prime will run you $8.
4. A reloading manual. Prices vary. Mostly for the instructions on this one. Loading data is available for free from powder manufacturer websites and with the Lee die sets, but you'll want a guide to step you safely through the process. (you might be able to find used manuals on Half.com or ebay. these would likely be cheaper than a brand new one)
And that should be it for a minimum setup. You can measure the charges with the powder scoops (you might want to get the whole set of scoops to help you with that). It'll be just as accurate as with the regular Lee loader anyways (as soon as you can afford it I'd recommend a proper powder scale though).
Now naturally as you progress you'll want a lot more "goodies" (a hand prime tool, a triming system, a tumbler, neck sizer dies, better press, etc), but the above will at least let you get a feel for reloading.
I'd personally recommend against the Lee Loader myself, unless you are on a VERY tight budget. Once you get your press bought then you can get die sets for not much more than the loader kits, and those will carry through with you when you eventually start loading with a press.
As someone mentioned earlier though, before you do ANYTHING with loading the ammo, make sure you read the steps in the loading manual several times over. Don't go outside of any data listed (and don't guess at any powder charges). If you know someone who has loaded before it would be great if you could get them to step you through it in person a few times before trying it on your own. And lastly don't be afraid to ask questions. I certainly don't mind answering whatever questions might pop up along the way, and I'm sure that everyone else here feels the same.