I agree with OKFCO5, you are anticipating the recoil and pushing the pistol down prior to the gun firing. Because 8 yards is only 24 feet and at that distance the change of the POI between 165 and 180 grain ammunition will be less than about 1/2 inch.
BTW, don't feel bad about growing a bit of a flinch, it's a perfectly natural response to a loud noise and blow to the hand. So, anyone who shoots a centerfire handgun long enough WILL have to learn how to cope with a flinch at some point. I've found what works for me is to concentrate on achieving a completely relaxed state as the gun fires. If you've ever studied Zen or done any meditation you'll find that this is possible but does require developing the proper mind set. BTW, getting it right can actually result in your leaving a shooting range in a much more relaxed state than when you entered.