Pearl Jam will headline this year’s Global Citizen Festival in New York City this weekend, and ahead of that appearance, the band stopped by the Late Show With Stephen Colbert for their first live gig of the year.

In addition to serving as Colbert’s musical guest, the band also sat down with the host for an interview during which they discussed the upcoming Global Citizen Festival and the importance of their charity and advocacy work. You can see the interview by watching the entire episode at the CBS website.

Eddie Vedder and company treated Colbert’s audience to a spirited rendition of their Lightning Bolt track, “Mind Your Manners.” Following chants for “one more song,” though, the band picked up with Neil Young’s “Rockin’ in the Free World.” For the latter, Colbert joined Vedder on vocals. Both looked like they were having a blast; Vedder even cut and run mid-song to commune with the audience. Check out both performances below.

Colbert will co-host Global Citizen Festival, which takes place on Sept. 26 in Central Park. This is the very first installment of Global Citzen since Coldplay frontman Chris Martin took over as curator, and he’s lined up a roster that includes his own band and Pearl Jam, plus Beyonce and Ed Sheeran.

Recently, Pearl Jam bassist Jeff Ament revealed the band hopes to record a follow-up to 2013’s Lightning Bolt within the next year.

Worst to First – Every Pearl Jam Album Ranked