For months people have been wondering what Stephen Colbert would do when his time as host of CBS’ Late Show came to an end.

Apparently his immediate plans were to dance the night away with his staff, loved ones and stars like Bette Midler at the Late Show wrap party Thursday night.

In videos shared by Gayle King and her CBS Mornings producer Gisela Margarita Pérez, Colbert could be seen enthusiastically cutting a rug to House of Pain’s “Jump Around,” taking the lyrics to heart and singing along as he was surrounded by a group of people doing the same.

He also could be seen dancing to Outkast’s “Hey Ya” with Bette Midler and his wife, Evie Colbert. There again Colbert was singing along and shaking his body “like a Polaroid picture” as commanded by the lyrics.

Along with a carousel of photos of King with Jon Batiste, Evie Colbert and Lin-Manuel Miranda at the celebration, the CBS Mornings host wrote on Instagram, “I can’t imagine late night without Stephen @colbert and yet here we are. I’m not the only one that feels that way and the people turned out for his wrap party in NYC. They hit the dance floor with Stephen who is clearly ready for things to come—and I can’t wait!”