Thanks for the responses. I do shoot "cheap" and therefore load mostly hardened lead bullets, so those suggesting my bullets are the biggest culprit are probably correct.
Being pretty new to reloading - only for about a year now - I was "throwing out" my powders to see if perhaps I was using something viewed as exceptionally dirty. Also, as these have been the only two powder I have used, looking for some suggestions for changing.
I do tend to load at the lower to mid-level for my semi-auto loads. With the lee disks you seem to be restricted a lot - bought an adjustable charge bar recently, but have not read up much on how it works, only that it apparently gives me a little bit more control over my loads.
Well, there ya go

If you were to shoot jacketed bullets (not saying you should) with the same powders you would see (or not see) a big difference. The lube tends to hold onto all the carbon and "stuff". I use HP 38/W 231 for pretty much any and all calibers and bullets. It works well. I see no reason to change.