Though it really depends on what model you're interested in. Heavier guns like a 29, 629, etc are much better on the recoil than say a 329NG.
I made the foolish choice of getting the Scandium snub-nosed before I was proficient with the higher caliber and ended up losing some money trading it for something I can use well.
If you feel comfortable with the big bore go for it, but ammunition for 357/38 is a lot cheaper and more then enough bang for the buck.