Did you lose the spring?
Both my 9FS and 9c have thumb safeties (since removed) and both have somewhat loose ejectors. I've taken the sear blocks apart on both and there's no way for the ejectors to be attached any more solid than they are (at least on the sear block with the thumb safety mechanism).