You are trying too hard! Just wipe it down all over with two or three patches wet with CLP and then wipe with a dry flannel rag and call it good. I generally use only 1 or 2 patches, including the bore and cylinder. You may not realize this, but if you work too hard on a blued gun what you see on the patches is actually the bluing being worn off the gun, not powder residue!
You are just going to shoot it again, there is no point in trying to get it "sterile" every time you clean it! You don't need to change patches just because one gets dirty, wet it good and scrub the gun thoroughly and then wipe with the flannel rag. If you wipe it once, then again, if it comes off clean on the second wipe you are done!
If you need patches, do not buy pre-cut ones. Go to a fabric store, or K-mart, Walmart, etc. and buy a yard or two of cotton "canton" flannel that is used to make baby pajamas. You can cut them whatever size you want, and have a handy rag too! Makes no difference if it is white, colored or has a pattern! This is much cheaper than pre-cuts and is the same material!