Pegge acquired a considerable proficiency in music at an early age. He composed a complete melodrama both the words and the music in score. Many catches and glees, and several of the most popular songs for Vauxhall Gardens were written and set to music by him. He was also the author of some prologues and epilogues which were popular including a prologue spoken by Mr. Yates at Birmingham in 1760. He also wrote an epilogue spoken by the same actor at Drury Lane on his return from France; and another epilogue, filled with pertinent allusions to the game of quadrille, spoken by Mrs. Yates at her benefit in 1769, 1770 and 1774. He was likewise the author of a pathetic elegy on his own recovery from a dangerous illness, and of some pleasant tales and epigrammatic poems.
Family
By his first wife, Martha, daughter of Dr. Henry Bourne, an eminent physician of Chesterfield, he had one son, Sir Christopher Pegge, M.D., and a daughter, Charlotte Anne, who died unmarried on 17 March 1793. He married, secondly, Goodeth Belt, aunt to Robert Belt, esq., of Bossall, Yorkshire. His son, Christopher, was a well known doctor in Oxford and also delivered lectures in mineralogy at Oxford University, and in 1800, the university purchased a cabinet of minerals from him which was to be part of the establishment of that subject at the university. Christopher Pegge, together with Wall and Bourne was one of the three most important doctors in Oxford in the early nineteenth century. quotes the following rhyme about them, entitled The Oxford medical trio: I would not call in any one of them all, For only "the weakest will go to the Wall"; The second, like Death, that scythe-armed mower, Will speedily make you a peg or two lower; While the third, with the fees he so silently earns, Is "the bourn whence no traveller ever returns".
Another rhyme, about Sir Christopher Pegge, went: Like Circe Sir C. can prescribe a mixt cup, But mixtures Circeian beware to drink up
Samuel Pegge's major works
An Elegy on the Death of Godfrey Bagnail Clerke, M.P. for Derbyshire, who died on 26 Dec. 1774, printed at Chesterfield.
Brief Memoirs of Edward Capell, Esq. 1790, in Nichols's ' Literary Anecdotes .
Curialia ; or an Historical Account of some Branches of the Royal Household, 5 parts, London, 1782–1806.
· , which were edited after Pegge's death by John Nichols.
Illustrations of the Churchwardens' Accompts of St. Michael Spurrier-Gate, York in Illustrations of the Manners and Expences of Ancient Times 1797.
Memoir of his father, Dr. Samuel Pegge', in Nichols's Literary Anecdotes .
, edited by John Nichols, London, 1803, 2nd edit, enlarged, to which is added a Supplement to the Provincial Glossary of Francis Grose, edited by John Nichols, London, 1814, 3rd edit., enlarged and corrected, edited by Henry Christmas, London, 1844.
Curialia Miscellanea; or Anecdotes of Old Times, regal, noble, gentilitian, and miscellaneous, including Authentic Anecdotes of the Royal Household'' edited by John Nichols, London, 1818