Its because you are looking, and maybe just a little too hard!

Rare treasures find you, not the other way around. The harder you look, the less you will see. Most gems appear when you least expect it.

Just pretend you're not looking and see what happens!!