I'm pretty sure Japan wasn't focusing on deer hunters when they decided not to invade the US. They were thinking about the huge additional front 5000 miles away. Add in that the most the major industrial areas were in the East, where they'd be difficult to get to. The US could train those deer hunter and send them to the war with endless tanks, planes, bullets and bombs.