If you're shooting 2-4" groups at 30 yards, you're doing better than the majority of shooters in out club...the sad thing is, most of them are also avid hunters!
In fact, I was shooting last night when a father and son showed up with a pair of SwitchBack XT's they've had all summer...they watched my shoot for a few minutes, then we started talking. They live less than a quarter mile from the clubhouse (indoor/outdoor shooting lanes ranging from 15 feet to 60 yards, and a hiking course with 20 targets [decoys and paper] at various distances, shooting through, over, under trees, brush, and creek bottoms). Either of the two were lucky to hit the paper-plate size target with one of five arrows at 30 yards...they were talking about how excited they were for friday (season opener).
I'm a handgunner for fun, and an archer for hunting--I enjoy the challenges involved with both. I usually spend the winter/spring shooting handguns at a local indoor range. I use the summer to brush up on my archery skills. Using fields points, I won't stop practicing until I am constantly damanging arrows/knocks at 30 yards...I practice out to 50 using paper plate size targets. Once i'm confident here, I'll add broadheads to the mix...fine tune, and get ready for opening day.
FWIW, I think you should practice to at least 40 yards...I'm not encouraging longer shots, but there will come a time when you have a REAL monster hanging up at 40-50 yards and at this point you'll be glad you prepared.
Also, I too suggest you practice from different angles and at targets of "unknown" distances. Being able to judge distances accurately is critical with archery.