Is your barrel nut tight?
Does your scope span from the upper to the hand guard?
The barrel is free floating from the barrel nut by the breech, so any pressure on the plastic hand guard can make it move. If the barrel nut is loose, you will not be able to correct anything until the nut is tight.