As long as the gun is secure that's all that matters. Worn out holsters can be dangerous. Holsters are not like other leather products where well "broken-in" is usually considered good. Like baseball gloves. I know a guy that ruined an expensive holster with Gloveoleum.

Worn Leather Holsters SAFETY WARNING: Accidental Discharges