Reflock the lower insert now and if you can't find an original upper insert (almost impossible) and don't want to spring for one of the fine reproductions produced by a forum member/vendor here, you can build your own upper insert as I do from cardboard, then flock it...It won't pass for OEM, but it's much better looking than leaving the raw mahogany inside...
Below is one I reflocked and used stiff cardboard to replace the missing insert...
...Ben