From E&P:

Colbert made fun of his mixed reception at the dinner, re-running the tape of one of his jokes with the audience barely reacting. He described this as “very respectful silence,” and said that actually the crowd loved him.

“They practically carried me out on their shoulders,” he said, “even though I wasn’t ready to go.”