Well you'll wind up with a hole in the frame to deal with,not likely to cause trouble but I'd be wary of debris getting in the guts with that hole.

I don't see why people get all bent out of shape about the safety,maybe you don't need it but it's nice to have,if you really don't want it I'd suggest trading it away for a non-safety model.