OCU's predecessor was founded in 1880, as Osaka Commercial Training Institute with donations by local merchants. It became Osaka Commercial School in 1885, then was municipalized in 1889. Osaka City was defeated in a bid to draw the Second National Commercial College, so the city authorities decided to establish a municipal commercial college without any aid from the national budget. In 1901, the school was reorganized to become Osaka City Commercial College, later authorized under Specialized School Order in 1904. The college had grand brick buildings around the Taishō period. In 1928, the college became Osaka University of Commerce, the first municipal university in Japan. The city mayor, Hajime Seki declared the spirit of the municipal university, that it should not simply copy the national universities and that it should become a place for research with a background of urban activities in Osaka. But, contrary to his words, the university was removed to the most rural part of the city by 1935. The first president of the university was a liberalist, so the campus gradually became what was thought to be "a den of the Reds ". During World War II, the Marxists and the socialists in the university were arrested soon after the liberal president died. The campus was evacuated and used by the Japanese Navy. After the war, the campus was occupied by the U.S. Army, and a number of students became anti-American fighters and "worshipers" of the Soviet Union. The campus was returned to the university, partly in 1952, and fully in 1955. In 1949, during the allied occupation, the university was merged into Osaka City University, under Japan's new educational system. In 1949 OCU had five faculties.
In 1953, the Faculty of Law and Literature was divided into two faculties.
In 1955, Osaka City Medical University was incorporated and became the Faculty of Medicine.
In 1975, the Faculty of Home Economics was reorganized into the Faculty of Human Life Science.
In 2003, the Graduate School of Creative Cities was established.
In 2006, the Urban Research Plaza and the Advanced Research Institute for Natural Science and Technology were established.
Due to financial problems in many cities, all of the municipal universities in Japan were requested to incorporate. OCU became a Public University Corporation in 2006.
In 2015 OCU celebrated its 135th anniversary. In June 2020, OCU announced it would be merging with Osaka Prefecture University in a new university named University of Osaka. However, after the name was announced on June 26, 2020, Osaka University President released a statement pointing out that the English version of the new university's name was "remarkably similar" to that of Osaka University, adding, "It will cause confusion among our students, and work as a great obstacle for the future of both universities, which are reaching out to the world."