Welcome to the FORUM, and nice gun! I have a few sets of rubber grips for my guns. None of them wears them. I just find beauty in nice wood.
Everyone has their own opinion. If you decide to go to wood, try to handle some S&W examples wearing different grips. Then decide what works for you. Bob