I’d say that was likely a holster cause. I had some generic one sitting around that seemed to fit my EZ well enough to use just while doing some stuff out in family property. After searching a half hour for my missing mag (finally found thankfully) i realized that holster did rub up against the button as I moved around.
Never had that issue when using my Crossbreed that was made for the EZ.