Madárka (Hungarian word for "Little Bird") started out as "Pop-up Gypsy Band" at a New Paltz art exhibit.

The founding members, Katalin Pazmandi and Harry Sweet, had previously played in another band, Szélrózsa. Katalin, a native of Hungary, is a powerful singer in many languages and Harry is a Yiddish speaker. Together, they bring a wealth of musical and historical knowledge of Hungarian, Roma, and Jewish traditional music. Accordion, saxophone, clarinet, recorder, fiddles, guitar, mandolin, bass, and percussion fill out the sound.