During World War I, Rose served as director of hospital libraries for the American Library Association. Returning to New York, in 1915, she served as head librarian at the Seward Park Branch, located in a Jewish immigrant community of New York City, until 1917. At Steward Park, she encouraged her assistants to become well versed in Jewish, Yiddish and Russian holidays, customs, and literature, intending to make them sensitive to the surrounding community. Rose became the branch librarian at the 135th Street Branch in Harlem in 1920. The branch had opened in 1905 when the neighborhood was inhabited by middle-class Jews, but a migration of southern Blacks, Caribbean, and South American Blacks following World War I changed the neighborhood to be a majority African-American neighborhood by the time Rose was appointed. The Harlem Renaissance of the time made Harlem a destination for black writers, artists, musicians, and scholars. Rose immediately noted that many cultural institutions weren't working with the new community and she wanted to make the library an integral part of the community that would provide guidance and promote racial pride. Her first role was to integrate the library staff, hiring four new library assistants of color, starting with Catherine Allen Latimer and including Pura Belpre and Nella Larsen Imes. She also worked to encourage community groups to hold meetings, reading and organized story hours, free public lectures, exhibitions of Black artists and sculptors and a reference collection of Black literature. In 1922, Rose worked with the ALA to organize a group of librarians to exchange ideas and discuss issues of working with African Americans. In 1924, Rose worked with Franklin F. Hopper, chief of the circulation department of the Central Branch, the National Urban League, and the American Association for Adult Education to secure a combined $15,000 grant from the Rosenwald Fund and the Carnegie Corporation. They formed the Harlem Committee, whose goals were to use the funds to develop cultural, vocational, and social programs within the Harlem community. They developed programs featuring well-known speakers, vocational classes through the YWCA and the Urban League. In 1926, the committee oversaw the purchase the Arthur A. Schomburg collection to incorporate into The Division of Negro Literature and History, later becoming the Schomburg Center for Research in Black Culture, at the library. The collection included "over 5,000 volume, 3,000 manuscripts, 2,000 etchings and portraits and several thousand pamphlets" showcasing the history and culture of African Americans. The grant also made possible the hiring of Schomburg to head the collection. In 1933, the library worked with the Works Progress Administration to host a writers project. Rose retired from the NYPL in 1942.