Høgh-Guldberg was born in Copenhagen in 1779 where he grew up with 6 siblings. His parents were prime minister Ove Høegh-Guldberg and his second wife Lucie Emmerentze Nørlem. Høgh-Guldberg married twice, first time in 1805 to Margrethe Pallene Hahn with whom he had 8 children, the second time in 1841 to Cathrine Johanne Emilie Friis with whom he had a son. His last born also became his namesake, Julius Emil Høegh-Guldberg and would eventually have a prominent career as well.
He settled in Aarhus and eventually became a member of the city council from 3 January 1840 to 8 January 1852 and was a chairman of it between 1842 and 1843. On 28 January 1859 he was awarded the Knight of the Order of the Dannebrog. In 1838 he replaced Thomas Funder as warden of the poor. In 1840 and until 1852 he was a member of the Church Inspectors for the Diocese of Aarhus. Between 1840-42 and 1852 he sat on the commission for the poor. Between 1840-47 he sat on the commission for billing, between 1840–46 and 1851-1852 he was on the commission for paving, between 1848 and 1849 he served as an auditor. From 1848 to 1849 he was on the budget commission, from 1849 to 1850 he was on the revenue commission. From 1850 to 1861 he served variously on the commissions for health, fire and safety and forests. As a city council member he also wrote summaries of city council meetings which were later published in Århus Stiftstidende, the first time information was published in that manner.
Philanthropy
Høegh-Guldberg was involved in philanthropy on many levels. He personally grew and gave away fruit trees to poor worker families and attempted to breed silk worms and get others interested. In 1821 he took initiative to establishing Aarhus Stiftstbibliotek and had a reading roomset aside just for technical material. Through the years he collected a large number of ancient artifacts which he later donated to the historisk-antikvariske selskab which would later become the Pre-historic Museum. Høegh-Guldberg sat on the board of Princess Caroline's Asylum for Children and was active in Prince Ferdinand's Drawing School, the forebear to Aarhus Tech which he is considered the founder of. He was also involved in founding the credit union Spare- og Lånekassen. In 1825 he rented a hilly, overgrown area outside the city walls by Studsgade's Port and landscaped it the year after under an agreement to plant 3000 trees on the land. This was the beginning of what would become the park of Vennelystparken, known as Guldbergs Have at the time. Høegh-Guldberg sat on the committee for future use of the park in 1849 and later on the committee for the park from 1852 and 1861.