JimmyJ, you have not told us exactly what firearm you are working with, and that could affect the opinions about the best method for fixing it.
Other people have given good advice about this issue, but I'll still offer the overall summary which came to mind for me. There are two well known methods for adjusting the windage on fixed sight revolvers. One method is to slightly torque the barrel so the sight moves a little in the desired direction. This method may or may not require removing the barrel, and possibly cutting the barrel so it screws in another turn. The other method is to whack the frame of the gun with a lead bar in a very judicious way. Note, that whacking the frame with a lead bar is not as crude as it sounds. It is my understanding that this is an actual factory armorers procedure and is done with a fair bit of finesse. It is recommended that this method should be left to people who have done it many times before.
Neither of these methods is likely to be a home repair, but either method is likely to give better aesthetic results than filing the front sight. If you have a relatively thick front sight, and you are good with a file, it may be possible to get good results by filing the front sight.
If you are working with a common gun that has a heavy barrel, then milling a dovetail, and going to a dovetail front sight, can also be a good option. There was a recent thread about someone who had this work done to a model 65, and the results were quite good.
On any recent gun that was under warranty, I would consider sending it to S&W and letting them use one of the factory armorer methods to correct the issue.