Formed in 1992, they were originally composed of Doug Marvin, Joseph Jurewicz, George Wilson, DJ Boudreau and Erika Forster. Performing regularly in New York, the band initially garnered attention for their sound, which featured alternating male and female vocals and layered, distorted guitar work reminiscent of My Bloody Valentine and the Jesus and Mary Chain. The band self-released their eponymous four-song debut EP in 2003, followed by a second EP, Sleep Late for a Better Tomorrow, in 2004. The latter was re-released on North Street Records in 2005. Forster left to concentrate on her other project, all-female indie pop trio Au Revoir Simone. On June 29, 2006, Dirty on Purpose released their full-length debut album, Hallelujah Sirens, on North Street Records. After critical praise from publications like Pichfork, Entertainment Weekly, NPR, Allmusic, Filter, Spin, Alternative Press, Hallelujah Sirens was nominated for Best Indie Rock Album at the 2007 PLUG Independent Music Awards. The band also co-hosted an episode of MTV2's alternative music show, Subterranean, with host Jim Shearer, which premiered the band's music videos for "Light Pollution," "No Radio" and "Mind Blindness". In 2008, Dirty on Purpose released their third EP, Like Bees, featuring guest female vocals from Jaymay and Holly Miranda. A final digital-only EP called Dead Volcanoes was issued via RCRD LBL later in 2008. During their career, Dirty on Purpose performed at various music festivals including SXSW, CMJ Music Marathon, Siren Music Festival, Pop Montreal, Seaport Music Festival, Street Scene San Diego and North East Sticks Together. The band also performed live on radio stationsKEXP, WOXY and Indie 103.1, and as the opening act for bands including Arcade Fire, the Decemberists, the Besnard Lakes, Band of Horses, Clap Your Hands Say Yeah, the Album Leaf, the Thermals, Earlimart, Say Hi to Your Mom and Fujiya & Miyagi. Dirty on Purpose broke up in 2008. On December 5, 2008, the band posted a blog entry on their MySpace page, stating "...we're going our separate ways", adding that they weren't interested in recording another album, but are still making music. The band went on to say that their tour with A Place To Bury Strangers would be their last, declaring, "...we thought it was an appropriate way to wind things down and say goodbye to our friends and fans". The band's final show, including a special appearance by Forster, took place on December 31, 2008 at New York'sMercury Lounge.
