If you want a super slick glossy finish, spray your final coat of poly out of an air brush and thin the poly before spraying. You can get an air brush at Harbor Freight for about $20. This will really give you the finish your looking for and you won't have to compond.
First thing is to sand with 400 grit to remove the brush marks. Then spray thin coats to fill. So, sand, spray, let the coat dry for a couple of days, then sand, and spray. Repeat. Depending on how smooth your wood is to start with will depend on how many coats you will need. Then after about 10 very thin coats start sanding with 600 grit. I'm not sure you have enough coats on to fill the voids left by the brush.
I use an air brush from start to finish, and it's simply the best way to apply a finish that I've found. Works great with tru-oil too.
The advantage of an air brush over a spray can is that you can control the air and the amount of the product, as well as the mixture.
Think thin.....very thin coats......