He was ousted as governor in 1861 for opposing secession from the Union. While he was a slave owner and state's rights proponent, he thought secession a stupid idea and would only bring misery to Texas and the South.

Dying in 1863, he didn't get a chance to say "told you so" about the cold northern avalanche he expected.