Rob Schmitt examines why Colbert 'had to go'