My solution was admittedly a bit unorthodox, but I basically smoothed/flattened the stippling a bit with the glazed side of a piece of old tile. Didn't risk marring the polymer that way, and the treatment made it tolerable enough to carry under a t-shirt in an AIWB position.
The stippling still allows plenty of grip.