If I was going to use the Governor for self defense, I would load it with 45 Colt, probably Speer Gold Dot 250 gr.

A .410 shotgun might be a good choice for small game, I wouldn't want to rely on it to stop human beings and the ballistics don't get any better out of a short barrel.