Fryer was the son of Richard Fryer, of Wednesfield and his wife Dorothea, daughter of John Wood of Wednesbury Hall, a descendant of the Hopes of Nechells Hall, Staffordshire, noted Royalists who supported Charles II. Fryer's grandfather, also Richard, was a descendant of the Fryers of Thornes, near Shenstone, where the family seat was an old hall surrounded by a moat. He was a banker and one of the founders of the UnionFlour Mill Company of Wolverhampton. He married heiress Mary Fleeming on 6 August 1794; she was the only child of William Fleeming, of The Wergs, Tettenhall, Wolverhampton. They lived at The Wergs Old Hall and had seven children, including Willian Fleeming Fryer who inherited the estates. The Fleemings were descendants of William Le Flemyng of Wightwick. Following a series of poor harvests and the practicality of steam-powered milling a co-operative mill had been set up in Birmingham by 1796. A committee in Wolverhampton was formed by Fryer, who was the committee's first chairman, until Benjamin Mander took over after the first few months. Shares were offered to the public and the funds were raised to build a large steam-powered mill on the banks of the Birmingham Canal Navigations at Horseley Fields, Wolverhampton. Flour production began early in 1813, and bread production started later the same year. Fryer had also purchased land on the corner of what is now Darlington Street and School Street, Wolverhampton. The localMethodists were looking to build a new church and the plot seemed ideal but there was opposition from Anglicans in the town fearing an increase in non-conformist influence. However Fryer was persuaded to sell for five shillings per square yard - £396 for the whole plot. Fryer and his son William Fleeming Fryer were local bankers for Spooner & Co., now part of Barclays bank.
In 1845 Fryer obtained a lease of land from Lord Hatherton for a colliery and ironworks near Leamore Lane, Bloxwich, where two furnaces were built in the 1850s. Richard's son, William Fleeming Fryer, leased the works, then known as Hatherton furnaces, to G. and R. Thomas of Bloxwich.