I too would recommend calling the Maker since there is no way I know of to permanently tightening the holster up. It sounds like it was either made of "loose" leather or was made too large.

A good quality holster will usually come very very tight and require a bit of break-in to get the gun in and out without force. After break in a good holster should hold it's shape and retention qualities for years to come.