The small amount of AA#2 is probably case sensitive. If you have your gun pointed down and bring it up to fire, the powder is going to be down by the bullet. If the rifle is pointed up, and brought down level to fire, the powder will be near the primer and should ignite fine.
What sounds like is happening is your powder is down by the bullet, your primer is going off, the pressure is forcing the bullet out of the case, the powder is being blown forward, and is not igniting.
For similar light loads of fast burning powders I put in an over powder wad. I make these wads out of the foam meat trays that you get at the supermarket. A fired brass cuts them out nicely. I enlarge the primer hole in a fired shell and put a nail thru the primer hole with head of the nail up inside the case. Cut out three or four wads and push them out of the case with the nail.
I charge 5-10 cases, then tap 1 (one) Uno, a single foam wad down onto the powder. This is good way to confirm no double charges and keeps powder near the primer. Then I seat the bullets.
You can do something similar to this, change powder, or go to a hotter primer.
Steve