I do the hand prime thing also.................

Prime ten cases and put them on a table top and see if they wobble, any.

A weak hand or worn plastic part can cause the primer to not seat fully.
Add a drop of oil to the unit also to smooth it up and help in seating the primer.

If you still have problems a new case holder might be in order ?

Good luck.