My SD9VE was my first gun, and looking back I may have sprung for an M&P, but at least I've had the chance to really make it my own as I like my guns being a little different. It also allowed me to learn amateur gunsmithing, and that some things are better left to someone with the proper tools. One of such things being the installation of a fiber optic front sight.
I agree with all except the comment on sights. I think the average owner can change sights on a SD-9/40 pistol -- with a little preparation.
I've been down the road on replacing sights on SD's and M&Ps.
You need the right tools, and it is important to remember that the sights go out to the right (towards the ejection port) and come in from the right. The dovetails are tapered!
I've removed sights with a wooden block and a hammer, holding the slide in a vise -- but much prefer a Sight Pusher. Some people use a punch, but that can mar or damage the sights = don't do it!
I've owned the Sight Pusher from MGW -- cost is around $125 -- and it is well-worth it. I think it pays for itself after you do the third sight; and then, as a bonus, you can always sell the Sight Pusher on eBay for $80-90 after you are done.
My SD currently has a Warren Tactical rear sight, and I think it is great. If I had a SD9VE with the plastic sight, I'd probably install a M&P style metal rear sight, or another Warren Tactical sight. Fiber optics sights, night sights, Big Dot sights, etc., are all viable options.