Fitting a .38 Special cylinder to a .38 S&W Victory model is quite reasonable. Depending on how the end-shake works out you may have to shim the replacement cylinder or, possibly, cut the yoke bearing surface in the cylinder back a little. Brownells sells a tool to clean up the this surface in the cylinder.
So far as differences in barrel dimensions is concerned I have never been able to verify if there is any design difference between the .38 S&W and .38 Special barrels, in spite of the "common knowledge" that the .38 S&W is larger by .003". I have challenged any one to prove this by providing a slug from a Victory Model that I could measure, but no one has ever responded!
For S&W to have simultaneously manufactured barrels of slightly different dimensions, that were indistinguishable from each other before rollmarks were applied simply is not logical, especially when a .361 nominal bullet can be fired through a .357-.358 barrel with no negative effects. This is exactly the same as the Model 1917 "Enfield" and Pattern 14 rifles manufactured during WWI. These were chambered for .30-06 and .303 British respectfully. The barrels were all manufactured on the same equipment with groove diameters from .311-.314. Needless to say a lot of the .30-06 rifles didn't shoot too well, but good enough for military purposes, 4" at 100 yds.
Anyone who has a .38 S&W M&P who will send me a barrel slug would be greatly appreciated!