What was supposed to be a GQ interview with Ezra Koenig on Sunday at Neuehaus in L.A. took a surprise turn into a short, but sweet, Vampire Weekend set.

After the conclusion of the chat, which was held in front of an invited audience, the band played two covers — Bob Dylan‘s “Jokerman” and The Honeycombs‘ British Invasion-era pop gem “Have I the Right” — plus their own “Cape Cod Kwassa Kwassa.”