Given that you are a lefty, you'll may want to consider adding an ambidextrous safety. Ruger sells one on their site but it appears to be a standard Wilson safety and it will need some hand fitting, like most aftermarket 1911 safeties.
The 7 yard groups are still a bit large, so on the one hand I'd work on consistency before I got too concerned about drifting the rear sight to the left or the front sight to the right. The rear sights moves the same direction you want the group to move, front sight moves the opposite direction. If the front sight looks centered, I'd adjust the rear sight.
On the other hand, my SR1911 9 mm CMD came shooting a bit to the left so it does not appear that Ruger gets too concerned about precise sight alignment before they leave the factory. I suspect they just install them to a mechanical zero and call it good.