You might have to modify your grip or experiment with the different sizes of palm swells. I was searching for a good video I saw earlier in the week but I can't find it. I'm not even sure it was on YouTube. It was deja vu because a long time ago when I was having trouble like you are I was shown the "proper" way of gripping a semi-auto & it worked. This video was about using the same or similar method. If I find it I'll post it. I don't even remember who was the one who had it on.

I have a friend with an M&P 40 & he has HUGE hands. It turned out that he shot the most accurate & consistent with the small palm swell. I have small to average hands & I get the best results on my M&P with the medium. I'm the most comfortable with that one & he said it felt awkward to him using the small but the proof was in his score so that's what he's sticking with.

__________________
Former USN, Retired US Army