Plenty of people in America despise him. And I would venture to guess that if Colbert were the Democratic nominee, he would beat Trump in a landslide.
Also, elections in Germany are far far less about the individual than about the party. Also all the rest @WinnieW said.