Service was born in Kilwinning, Ayrshire, Scotland, the son of Robert Service. As a young man James worked in a Glasgow tea importing business, Thomas Corbett and Company. In 1853 he arrived in Melbourne as a company representative, and the following year went into business on his own forming James Service and Company, importers and wholesale merchants, which became a large and prosperous organization still in business many years after his death. He was a founding member of the Emerald Hill municipal council in 1855, and of the Commercial Bank of Australia in 1866, going on to become a prominent banker and representative of Melbourne business interests. Service was elected to the Victorian Legislative Assembly for Melbourne in a by-election in March 1857, retaining this seat until August 1859. He then represented Ripon and Hampden from October 1859 to around August 1862, Maldon from May 1874 to March 1881 and Castlemaine from June 1883 to February 1886. He was a moderate liberal in the context of Victorian politics, but as a free trader he increasingly sided with the conservatives, since all the more radical liberals were protectionists. He was President of the Board of Land and Works in the Nicholson government from 1859 to 1860 and Treasurer in the Kerferd government from 1874 to 1875. His attempt to cut tariffs in his 1875 budget led to the fall of Kerferd's government. When Graham Berry's radical ministry fell in March 1880, Service formed a minority government. In May Service admitted that he could not go on and asked the Governor, Lord Normanby, for a dissolution, which was granted. But the elections did not improve Service's position and in August he resigned, allowing Berry to return to power. In March 1883 the liberals under Berry's successor, Sir Bryan O'Loghlen were defeated at elections, and Service formed a new and much stronger government, taking the Treasury as well as the Premiership. When Service agreed not to attempt to reduce tariffs, Berry joined him as a minister: such was the fluidity of party politics at this time. The young Alfred Deakin held office for the first time in this government. The Service government lasted three years and passed some important legislation, including a Public Service Act which removed political patronage from the public service, a new Factories Act and a new Lands Act. In June 1883, at a banquet at Albury celebrating the opening of the railway line between Sydney and Melbourne, Service raised the question of Australian federation. He supported Sir Thomas McIlwraith in his action with regard to the annexation of New Guinea, and suggested the inter-colonial conference which was held at Sydney in November 1883. There a bill constituting a federal council was framed which was carried by Service through the Victorian parliament in 1884. Service himself desired the establishment of a federal government, but the other premiers were comparatively lukewarm and the proposed council was to have very limited powers. By the time of the 1886 election Service was in declining health and decided to retire from active politics and return to England for a while. In 1888 he was elected to the Victorian Legislative Council for Melbourne Province, and served there until April 1899.