The Scotchtown property was given as a land grant to Charles Chiswell, a prominent planter and iron mine owner, in 1717. Chiswell built a small house on the property, probably in the 1720s. It was expanded to its present size around 1760. It was first given the name "Scotch Town" in a 1757 deed of sale. At this time the house also was used as a store that bought and sold local tobacco. Patrick Henry purchased the house in 1771 and lived there with his wife, Sarah Shelton Henry, and their six children. This was his home during his most influential period, including his famous "Give Me Liberty, or Give Me Death!" speech at St. John's Episcopal Church inRichmond, Virginia. It was also his residence when he was elected Governor of Virginia in 1776. His wife Sarah, who suffered from mental illness, died at the site in 1775. He resided at Scotchtown until 1777. That year he married his second wife and in 1778 they relocated, after his election, to the Governor's Palace in Williamsburg. Beginning in 1801, the property was owned by the Sheppard/Taylor family. In 1958 it was purchased by Preservation Virginia. Little is known about the Sheppard-Taylor family, other than the changes they made to the appearance of the house over the generations. Scotchtown was long believed to have been the girlhood home of Dolley Madison, wife of president James Madison, who was a relative of Patrick Henry. But, there is little evidence beyond Madison's own recollections of the house as a child to support this fact. Dolley Madison's recollections may have been memories of visits to the house during her childhood.
Preservation
The property was sold at auction in July 1958, when it was purchased by Preservation Virginia for $37,000. Extensive archaeological work has taken place in the decades following. A number of projects have restored the house to its late 18th-century appearance, including rebuilding outbuildings such as the icehouse, kitchen, and law office. Scotchtown was declared a National Historic Landmark in 1965 as an unusual 18th-century structure associated with a Founding Father. The property received a grant from the Institute of Museum and Library Services in 1993 to "reexamine its policies, procedures, and the current condition of its collection and structures," including restructuring its programming. It is currently open for visitors seasonally or by appointment.