A lot of people are wondering how Stephen Colbert will do replacing David Letterman's role as the host of 'The Late Show' -- turns out he had the chance to work on the show when he was in college, but passed it up! 

Here's why: