The rough-cut stone castle-like main house is built around a main block with a conical-roofed round tower. Porches and verandas project from many sides of the home to take advantage of the views of the river and mountains in the area. The roof is consistent red slate, with dormers of differing shapes and sizes scattered throughout. One gable to the east uses dressed stone, in contrast with the rest of the building. A north wing with library and extra bedrooms were added later. Four interior chimneys are within the mansion. In 2010, extensive historic restoration work was completed to repair the entire slate roof, tower, dormers, and chimneys. There are several outbuildings and other structures on the original property that are included as contributing resources. To the northeast, on the mountain's summit, is Woodsome Lodge, a rustic log cabin with its own views of the Highlands. The estate's spring-fed wooden water tank is also nearby. A stone arch bridge was added at the same time as the library wing. Stone was also used for a -story gatehouse along the winding driveway leading up to the house from Cat Rock Road. Buildings that predate the estate are also included. A -story farmhouse known locally as Wing & Wing, built some years before it was expanded into a contemporary cottage in 1858, is near Route 9D on the open meadows between the road and the hill. Also there is a barn-and-farmhouse complex, with nearby shingled home, built by other landowners at the end of the 19th century. A small guest cottage was later built on a separate property. Another Osborn-estate–related property, The Birches, is at the very corner of Routes 9D and 403. It was used by Osborn's sons after their weddings, and is listed separately on the National Register, but was not formally part of the estate.
History
In 1855 Osborn, who had been one of the charter officers of the Illinois Central two years earlier, visited the Highlands to take in the fresh air and scenic beauty of the area. He enjoyed his visit so much that he decided to buy the property where Castle Rock and its associated properties now stands. He and his family spent summers in Wing and Wing until the castle was completed the year before he retired from the railroad industry as president of the Chicago, St. Louis and New Orleans Railroad. He lived there until his death in 1894, devoting his time and money to philanthropic activities in New York. It was inherited by his son Henry Fairfield Osborn. Since it was intended as a retirement house, it needed to be expanded to accommodate the younger Osborn's wife and family. The library wing was added in 1906; most of Osborn's paleontological papers were written at Castle Rock. Osborn also made other improvements to the property, including Woodsome Lodge, and other wings that doubled the size of the original castle. Most of these were architecturally sympathetic to Slade's original design, and there has been little change to it since then. In 1974, William Henry Osborn II, one of Henry Fairfield's younger sons, donated the southern portion of the property, which includes Sugarloaf Hill, to the State Parks Council for eventual inclusion in Hudson Highlands State Park. In the late 1970s, after the property was listed on the Register, New York'sDepartment of Environmental Conservation bought of the former estate, including the meadows along Route 9D, and opened it to the public as the Castle Rock Unique Area. Hiking trails now lead through it and up the mountain; however the house property remains private.