Balieff is believed to have been born in Erzerum, Ottoman Empire in 1873, he left for Moscow in 1906 and took a job at the Moscow Art Theater under Konstantin Stanislavski. After years of only non-speaking roles, and with a desire to perform comedy rather than drama, Balieff co-created his own theater group in a basement near the Moscow Art Theater. He named the troupe La Chauve-Souris after a bat flew up out of the basement door and landed on his hat. Chauve-Souris enjoyed much success and popularity in Moscow, until the Russian Revolution in 1917. Balieff then went into exile in Paris and began presenting vaudeville shows there with other Russian émigrés. He was noticed by the British theatrical producer Charles B. Cochran, who brought the troupe to London.
In 1922 Chauve-Souris made its first tour to America through an arrangement with the producer Morris Gest. Balieff and his company toured from Washington, D.C. to California for 65 consecutive weeks. Between 1922 and 1929, Balieff returned to America to tour six times, appearing on Broadway in 1922, 1923, 1925, 1927, and 1929, with one final show billed as New Chauve-Souris in 1931. His shows consisted of songs, dances, and sketches, most of which had been originally performed in Russia. One of his most popular acts, The Parade of the Wooden Soldiers, which used the Leon Jessel tune "Die Parade der Zinnsoldaten", referenced a story regarding Tsar Paul I. The legend claims the Tsar left his parade grounds without issuing a "halt" order to the marching soldiers. Without one, the soldiers marched to Siberia before being remembered and ordered back. The Balieff vaudeville version with its popular tune was a mainstay in Chauve-Souris, and later became part of The Rockettes repertoire as well. Wooden Soldiers was filmed in the DeForest Phonofilm sound-on-film process, and premiered on 15 April 1923 at the Rivoli Theater in New York City, along with 18 other short films made by DeForest. This short film is located in the Maurice Zouary collection at the Library of Congress. Balieff was known for his feigned lack of English on stage. His monologues and introductions were delivered in a mix of Russian, French, and English language and slang coupled with much gesticulation. However, in private his English was better than that of his stage persona. His company toured Europe and South Africa, appearing in major capital cities. He was married to Helena Komisarjevska, a member of one of his theatrical companies. In 1927 he was featured on the cover of Time magazine. In 1934 Balieff created a new Chauve-Souris production, which proved to be his last theatrical venture. The fall of that year marked his final stage appearance: , a revue at the Helen Hayes Theatre, which featured Lucienne Boyer. He also appeared in the Ben Hecht-Charles MacArthur film, Once in a Blue Moon.