Have owned numerous 22-250s, and 223s. The 204 I know nothing about, but suspect the brass is not that easy to acquire, and ammo probably ain't cheap when you find it.
The 223 is my favorite of all three, and is extremely accurate in itself. Just ask the boys a Camp Perry rifle matches. The 223 is plentiful, cheap, and easy to learn to shoot well with no recoil. It's a good varmint round out a little past 300 yards, and I use it for hogs and deer when I get the chance and my 3030 is along.