The Late Show With Stephen Colbert made its highly anticipated premiere last night (Sept. 8), and it came to an epic close with the help of Colbert’s bandleader Jon Batiste, his house band, Stay Human, and a host of all-star guests.

Playing Sly & the Family Stone’s “Everyday People,” Batiste was joined by the likes of Mavis Staples, Alabama ShakesBrittany Howard, Ben Folds, members of Beirut, Buddy Guy, St. Paul and the Broken Bones’ Paul Janeway, Aloe Blacc, Derek Trucks and more. Colbert even contributed a verse to the celebratory performance. You can watch the entire thing in the video at the top of the page; the full episode can be seen over at CBS' website.

In addition to the impressive musical portion of the show, Colbert’s very first guests were George Clooney and Jeb Bush. Tonight (Sept. 9), Colbert will be joined by Scarlett Johansson and Elon Musk. And while tonight’s episode may not include a virtual all-star supergroup, the musical guest will be just as exciting when Kendrick Lamar performs.

After announcing he would take over the Late Show reigns following David Letterman’s retirement, Colbert concluded his run on Comedy Central’s The Colbert Report back in December.