I owned a 625 5" and stupidly sold it a couple of years ago. I've been kicking myself ever since. I feel much better now because this week I just acquired a 625 JM. In my opinion, the 625 is one of the greatest revolvers ever made by Smith. It's accurate, superbly balanced, fires a round that creates a big hole, and, with moon clips, can be reloaded faster than a semi.
I've never fired a 325 although I'd like to. I've handled a couple recently, however. The gun is MUCH lighter than a 625, weighing about 1/2 as much. My guess is that accuracy is unaffected by the lighter weight but that handling almost certainly would be. I would expect substantially more muzzle flip from the 325 than from the 625 and, of course, much greater perceived recoil from the lighter gun. That certainly would affect my ability to bring the gun back on target after discharging a round. I'm pretty confident that I'd be quicker reacquiring the target with the JM than with a 325.