Have you ever heard of bending an Upper receiver?

[dmsims21]

There may be some crud between the upper and barrel extension, or the receiver face may be dinged up. 0.004" could throw POI off 12"
It is worth taking it back apart. I would get the reaction rod for the barrel removal.

That brings up another question. How much shift in POI should you expect when removing/reinstalling a barrel.