My take down lever is smooth and when in 6 o'clock position totally covers said roll pin. Further travel past 6 o'clock is prevented by raised edge of frame 2 mm forward of pin. Are you looking at a Shield ggibson?
Should be at least flush. If it were mine I would support off side with not marring material and seat pin with proper size punch. I just checked mine and that pin is seated just a little short of flush, but it does not interfere with takedown. Can you take a pic of it? This is simple stuff S&W...