I don't think that bulge you have will severely reduce the life span of the brass.

Most brass I lose over time is from the belling/flaring stage. It gets worked over pretty good on every loading. That's why I keep mine to the bare minimum to get the bullet in the casing without scraping.

I see more case ring bulging from trying to crimp too hard.

If you don't like that bullet being swaged down; try getting a new, larger size plug/stem for the expander die. The "nest" will be larger and not swage down the bullet.

Prescut