Leaving it loaded will help relax the spring. It will stay good for a long time. If you are a right handed shooter shooting left is normal. If you dry fire you will see that the muzzle moves left is you don't pull the trigger straight back. Let us know about how high and how left. Let us know what distance.

Trigger control takes practice. Your hand muscles pull different directions. Dry Fire (empty, check three times) practice helps. If you see the sights move during dry fire that's what's happening during live fire. Practice.