I had that happen once in a folded leather holster while repositioning the holster while seated. I suspect a Kydex retention type holster would cover that area better with less interference.
A shorter mag release button or stiffer spring might help.