Are you using Dillon dies with the press? The Dillon sizing die incorporates a spring-loaded de-capping pin that compresses when pushing the primer out. When primer clears the pocket the de-capping pin snaps down shaking the primer off the pin.

If you already have the Dillon die remove the de-capper assembly, thoroughly clean it and re-install.