Powder: Large quantities of MILSURP from gibrass.com. Available elsewhere also. Canister: Local Gun Shops
Primers: Graf's, Widners, gun shows. Sitting on 30,000 right now of various types
Bullets: The garage. Casting is THE way to go for all of your handgun and lots of your carbine needs. Jacketed bullets; online. Powder Valley, Graf's, Widners
Cases: I have enough from over 35 years of shooting that I need no more. When I started, factory ammo. Now, I buy range brass from a local range @ $20 for a 5 gallon bucket.
Gotta look for deals and get familiar with the folks that run local stuff. Close friends that have connections works real well for me too!