It's not a problem until you have a problem. I wouldn't do that, especially with a .40SW, but use your own judgment. There is no black/white answer, but remember, as Dr. Schuler used to say, "Bad things DO happen to good people." Is one round worth more than your safety? Compare the cost of a box of ammunition to a new gun, or repair work on the fingers of your gun hand.