Take your gun to a gunsmith and have your chambers measured and compared with SAAMI specs for .22 LR. You can’t make any sort of intelligent decision about what to do without first knowing what you have. The possibility of a slight “reverse taper” (i.e., larger diameter at the barrel-end of the chamber) would definitely affect extraction and that is also something to check. You can’t check for that with pin gages, unfortunately. It’s going to require careful measuring, since your chambers could also be a bit out of round.

My guess is that your chambers are tight or show a small reverse taper, not oversized. “Polishing” your chambers would have to be done by lapping, to preserve roundness. Fiddling around with attempts at polishing without considering roundness is liable to end up causing more trouble, not less.

Carefully touching up the chambers with a sharp .22 LR reamer sometimes fixes this problem. And sometimes it makes things worse, depending on how expertly it is done, and whether the reamer is up to the job. One that’s not sharp wont be. If you buy a reamer, don’t buy a “match” chambering reamer.