I've never worried about the white dot falling off. I've found that shooting and cleaning darkens them up over time, so you need to periodically "refresh" the paint anyway.

As far as the roll pin falling out, yes, that should not happen. However, it's a five cent part. I just replace the defective pins with new ones from my local hardware.