The comedian says he was invited to Trump Tower by the transition teams for the president elect and President Obama.