For what you'll be loading, a single stage press will fit the bill, no need to go progressive.
A progressive press performs multiple tasks simultaneously, and generally speaking is used for large volume.
A single stage press performs each task separately, and is the best way to learn the reloading procedure.
A good way to get familiar with the equipment and the process would be to get the Lyman reloading manual first. Read the sections on "how to", and then go to a store that has equipment on display. Look it over and ask questions.
The basics needed are the press, a good quality powder scale, the dies for whatever caliber, and a good manual, which the Lyman is. You will end up buying all kinds of equipment as time goes on, but these are the absolute essentials.