OK, so I had to drive the sight to the rear with a mallet and then pry it out with a screw driver.
Then after inspection I removed the roll pin which made it much easier to install the new sight.
All is good now.