After college he began constructing a garden on private property in Cold Spring, New York, above the Hudson River, beginning a lifelong passion for horticulture. Cabot was appointed Chairman of the New York Botanical Garden in the Bronx from 1973 to 1976. In 1989, he founded the nonprofit Garden Conservancy, after noting that two-thirds of America's great gardens had been destroyed by development. The Conservancy began with "four acres of giant cactuses, succulents and native species" in Walnut Creek, California, the life's work of gardener Ruth Bancroft. The organization's Open Days program has opened more than three hundred private gardens to the public throughout the United States and has been active in the preservation of seventeen important private gardens for posterity, including the rehabilitation of the gardens at Alcatraz. Cabot has become renowned for his personal gardens around the world. His own garden in Cold Spring, known as Stonecrop, was opened to the public in 1992 and is now one of the premier public gardens in the United States, encompassing sixty-three acres. Its components were influenced and improved in the 1980s by horticulturist Caroline Burgess, who became the garden's director, having previously worked with legendary English gardener Rosemary Verey. Cabot's private garden in the Charlevoix region of Quebec covers more than and is called Les Quatre Vents. He is credited with introducing a number of plants and grasses to North America, including Japanese blood grass. Les Quatre Vents has thematics fields like "Le lac Libellule", "le Pavillon japonnais de méditation", "le Pigeonnier", "le pont chinois de lune", "le kiosque à musique", "le potager" and more. In 2001, he wrote the book The Greater Perfection: The Story of the Gardens at Les Quatre Vents, which was the recipient of the 2003 Annual Literature Award of the Council on Botanical and Horticultural Libraries and which the Oxford Companion to Gardens referred to as "one of the best books ever written about the making of a garden by its creator." Mr Cabot was also very involved in the preservation of old mills. Heritage Charlevoix, his foundation, bought "Le Moulin La Rémi" in Baie-Saint-Paul, also in Charlevoix. He invested money to rebuild this very beautiful building. In 2000, he was made a Chevalier of the National Order of Quebec. He was awarded the Veitch Memorial Medal of the Royal Horticultural Society in 2002. In 2005, he was made an honorary Member of the Order of Canada. Shortly before his death, Cabot was interviewed at length for the documentary filmThe Gardener by Sebastien Chabot, explaining his philosophy of gardens and the history of his own garden.
Personal life
In 1949, Cabot married Anne Perkins. They had three children: Colin Cabot, Currie Cabot, and Marianne Cabot.