I think switching to a set of aftermarket (metal) sights will pretty much eliminate the OP's problem without changing holsters. It would take a lot of drawing and reholstering to wear down a metal front sight.