Tani was born to a farming family in Okayama Prefecture. He graduated from the 15th class of the Imperial Japanese Army Academy in 1903, placing 16th in his class. One of his classmates, Yasusuke Nogi, was the younger son of General Nogi Maresuke, and later died in combat during the Russo-Japanese War. Tani also saw combat during that war as a second lieutenant in the Guard's First Infantry Battalion, although his training at the academy had been in artillery. After the war, he graduated in third place from the 24th class of the Army War College in 1912. Tani later wrote an account of his experiences in the war, together with first-hand accounts of survivors, which was published under the tile Secret History of the Russo-Japanese War. The book became a required textbook for the Army Staff College, although it was criticized by Field MarshalUehara Yusaku for inaccuracies. Tani was posted to Great Britain as a military attaché from 1915, and from August 1917 he was embedded in the front lines as an official military observer for the Japanese government on the combat situation on the Western Front in World War I. After his return to Japan, in April 1919 he served as an instructor at the Army Staff College, and was reappointed to that position in February 1924. In February 1927 he was promoted to colonel and made commander of the IJA 61st Infantry Regiment. In August 1928, he became chief-of-staff of the Nagoya-based IJA 3rd Division. In May 1930, Tani was named to the League of NationsStanding Committee on Military Aviation. He was promoted to major general in August 1930. He returned to Japan in 1932 to become Chairman of Military Investigation, and from August 1933 was commander of the Guards 2nd Brigade. he was promoted to lieutenant general in August 1934. He served as commander of Tokyo Bay Fortress from August 1934 to December 1935. He was then sent to Kumamoto to oversee the reconstruction of the IJA 6th Division.
In February 1946, Tani was arrested on orders of the American occupation authorities and charged with Class B and Class C war crimes. At the request of the Chinese government he was extradited to China to stand trial at the Nanjing War Crimes Tribunal in August 1946. Tani denied all charges at the trial, stating that his troops kept discipline, and the area of Nanjing assigned to his division had been largely evacuated due to the ferocity of the battle. Furthermore, none of the witnesses against him could identify his unit numbers, and indeed the evidence presented to the court pertained to troops and areas of the city under General Kesago Nakajima and General Shigeharu Suematsu. However, the presiding judge refused Tani's request to call on his chief of staff and surviving junior officers as witnesses, and stated that since the various atrocities which occurred in Nanjing were testified to by hundreds of surviving witness as well as several foreigners from Nanking Safety Zone, he was unwilling and unable to divide responsibility. According to the ruling of the court, all of the Japanese commanders involved in the Battle of Nanjing had an equally shared responsibility for atrocities which occurred during the Rape of Nanjing, and this included Generals Iwane Matsui, Heisuke Yanagawa and Sadao Ushijima as well as Nakajima, Suematsu and Tani. He was consequently sentenced to death as a BC-class war criminal and was executed by firing squad outside the gates of Nanjing on April 26, 1947.
Family
Tani's son, Hayao Tani, was also an officer in the Imperial Japanese Army. A graduate of the 49th class of the Imperial Japanese Army Academy and the 58th class of the Army Staff College, he was a colonel on the staff of the IJA 34th Army and was killed in combat in November 1944.