The 422 is a nice .22. From the situation you describe, it sounds best if you stick with HV .22 LR. The 422 owner's manual is not available online, but I would guess it has the usual "use ammunition intended for the gun" statement. If it runs perfectly with it, don't mess with success.
Also, I doubt using HV will wear it out more quickly, especially since you will eventually start using the gun like a hammer in frustration if you keep using SV
. Hope this is helpful.