Intelligence in the American Revolutionary War


During the American Revolutionary War, the Continental Army and British Army conducted espionage operations against one another to collect military intelligence to inform military operations. In addition, both sides conducted political action, covert action, counterintelligence, deception, and propaganda operations as part of their overall strategies.
American intelligence was monitored and sanctioned by the Continental Congress to provide military intelligence to the Continental Army to aid them in fighting the British during the American Revolutionary War. Congress created a Secret Committee for domestic intelligence, a Committee of Secret Correspondence for foreign intelligence, and a committee on spies, for tracking spies within the Patriot movement.
British espionage efforts were overseen by the British Army and focused primarily on gathering military intelligence support military operations.

American organizations involved in espionage

Secret Committee

The Second Continental Congress created a Secret Committee on September 18, 1775. The Committee was not, however, a true intelligence agency, since the Committee of Secret Correspondence with which it often worked was mainly concerned with obtaining military supplies in secret and distributing them, and selling gunpowder to privateers chartered by the Congress. The Committee also took over and administered on a uniform basis the secret contracts for arms and gunpowder previously negotiated by certain members of the Congress without the formal sanction of that body. The Committee kept its transactions secret and destroyed many of its records to ensure the confidentiality of its work.
The Secret Committee employed agents overseas, often in cooperation with the Committee of Secret Correspondence. It gathered intelligence about secret Loyalist ammunition stores and arranged to seize them. The Committee also sent missions to seize British supplies in the southern colonies. It arranged the purchase of military stores through intermediaries to conceal the fact that Congress was the true purchaser. They then used foreign flags to attempt to protect the vessels from the British fleet.
The members of the Continental Congress appointed to the Committee included some of the most influential and responsible members of Congress: Benjamin Franklin, Robert Morris, Robert Livingston, John Dickinson, Thomas Willing, Thomas McKean, John Langdon, and Samuel Ward.

Committee of (Secret) Correspondence

The Second Continental Congress recognized the need for foreign intelligence and foreign alliances, and created the Committee of Correspondence by a resolution of November 29, 1775. The original Committee members—America's first foreign intelligence agency—were Benjamin Franklin, Benjamin Harrison, Thomas Johnson and subsequently included James Lovell, who became the Congress' expert on codes and ciphers and has been called the father of American cryptanalysis.
The committee employed secret agents abroad, conducted covert operations, devised codes and ciphers, funded propaganda activities, authorized the opening of private mail, acquired foreign publications for use in analysis, established a courier system, and developed a maritime capability apart from that of the Continental Navy, and engaged in regular communications with Britons and Scots who sympathized with the American cause. It met secretly in December 1775 with a French intelligence agent who visited Philadelphia under cover as a Flemish merchant.
On April 17, 1777, the Committee of Secret Correspondence was renamed the Committee of Foreign Affairs, but kept with its intelligence function. Matters of diplomacy were conducted by other committees or by the Congress as a whole. On January 10, 1781, the Department of Foreign Affairs—the forerunner of the Department of State—was created and tasked with "obtaining the most extensive and useful information relative to foreign affairs", the head of which was empowered to correspond "with all other persons from whom he may expect to receive useful information."

Committee on Spies

On June 5, 1776, the Congress appointed John Adams, Thomas Jefferson, Edward Rutledge, James Wilson, and Robert Livingston "to consider what is proper to be done with persons giving intelligence to the enemy or supplying them with provisions." They were charged with revising the Articles of War in regard to espionage directed against the American forces. The problem was an urgent one: Dr. Benjamin Church, chief physician of the Continental Army, had already been seized and imprisoned as a British agent, but there was no civilian espionage act, and George Washington thought the existing military law did not provide punishment severe enough to afford a deterrent. On November 7, 1775, the death penalty was added for espionage to the Articles of War, but the clause was not applied retroactively, and Dr. Church escaped execution. On August 21, 1776, the Committee's report was considered by the Congress, which enacted the first espionage act. It was resolved further that the act "be printed at the end of the rules and articles of war." On February 27, 1778, the law was broadened to include any "inhabitants of these states" whose intelligence activities aided the enemy in capturing or killing revolutionary forces.

British organizations involved in espionage

Compared to American espionage efforts, British efforts were limited during the first four years of the war. General Henry Clinton was notionally in charge of the British Army's espionage efforts, which had minimal impact on British military operations. In May 1779, Clinton appointed his aide-de-camp John André as the head of British espionage operations in America. André began to develop a more formalized espionage apparatus, including creating a spy network that expanding outside New York City and employment of cipher codes to protect communications with spies.

Techniques

Secrecy and protection

The Committee of Secret Correspondence insisted that matters pertaining to the funding and instruction of intelligence agents be held within the Committee. In calling for the Committee members to "lay their proceedings before Congress," the Congress, by resolution, authorized "withholding the names of the persons they have employed, or with whom they have corresponded." On May 20, 1776, when the Committee's proceedings—with the sensitive names removed—were finally read in the Congress, it was "under the injunction of secrecy." The Continental Congress, recognizing the need for secrecy in regard to foreign intelligence, foreign alliances and military matters, maintained "Secret Journals," apart from its public journals, to record its decisions in such matters. On November 9, 1775, the Continental Congress adopted its own oath of secrecy, one more stringent than the oaths of secrecy it would require of others in sensitive employment. On June 12, 1776, the Continental Congress adopted the first secrecy agreement for employees of the new government. The required oath read:
I do solemnly swear, that I will not directly or indirectly divulge any manner or thing which shall come to my knowledge as of the board of War and Ordnance for the United Colonies... So help me God.

The Continental Congress, sensitive to the vulnerability of its covert allies, respected their desire for strict secrecy. Even after France's declaration of war against England, the fact of French involvement prior to that time remained a state secret. When Thomas Paine, in a series of letters to the press in 1777, divulged details of the secret aid from the files of the Committee of Foreign Affairs, France's Minister to the United States, Conrad Alexandre Gérard de Rayneval, protested to the president of the Congress that Paine's indiscreet assertions "bring into question the dignity and reputation of the King, my master, and that of the United States." Congress dismissed Paine, and by public resolution denied having received such aid, resolving that "His Most Christian Majesty, the great and generous ally of the United States, did not preface his alliance with any supplies whatever sent to America."
In 1779, George Washington and John Jay, the president of the Continental Congress and a close associate of the Commander in Chief's on intelligence matters, disagreed about the effect disclosure of some intelligence would have on sources and methods. Washington wanted to publicize certain encouraging information that he judged would give "a certain spring to our affairs" and bolster public morale. Jay replied that the intelligence "is unfortunately of such a Nature, or rather so circumstanced, as to render Secrecy necessary." Jay prevailed.

Cover

, an important American agent in the British-occupied city of New York, used the guise of being a merchant, as did Silas Deane when he was sent to France by the Committee of Secret Correspondence. Townsend was usually referred to by his cover name of "Culper, Junior." When Major Benjamin Tallmadge, who directed Townsend's espionage work, insisted that he disengage himself from his cover business to devote more time to intelligence gathering, however General Washington overruled him. Townsend also was the silent partner of a coffee house frequented by British officers, an ideal place for hearing loose talk that was of value to the American cause.
Major John Clark's agents in and around British-controlled Philadelphia used several covers so effectively that only one or two operatives may have been detained. The agents traveled freely in and out of Philadelphia and passed intelligence to Washington about British troops, fortifications, and supplies, and of a planned surprise attack.
Enoch Crosby, a counterintelligence officer, posed as an unsuspecting shoemaker to travel through southern New York state while infiltrating Loyalist cells. After the Tories started to suspect him when he kept "escaping" from the Americans, Crosby's superiors moved him to Albany, New York, where he resumed his undercover espionage.
John Honeyman, an Irish weaver who had offered to spy for the Americans, used several covers to collect intelligence on British military activities in New Jersey. He participated in a deception operation that left the Hessians in Trenton unprepared for Washington's attack across the Delaware River on December 26, 1776.

Disguise

In January 1778, Nancy Morgan Hart, who was tall, muscular, and cross-eyed, disguised herself as a "touched" or emotionally disturbed man, and entered Augusta, Georgia, to obtain intelligence on British defenses. Her mission was a success. Later, when a group of Tories attacked her home to gain revenge, she captured them all and was witness to their execution.
In June 1778, General Washington instructed Henry "Light Horse Harry" Lee to send an agent into the British fort at Stony Point, New York, to gather intelligence on the exact size of the garrison and the progress it was making in building defenses. Captain Allan McLane took the assignment. Dressing himself as a country bumpkin and utilizing the cover of escorting a Mrs. Smith into the fort to see her sons, McLane spent two weeks collecting intelligence within the British fort and returned safely.
While serving in Paris as an agent of the Committee of Secret Correspondence, Silas Deane is known to have used a heat-developing invisible ink—a compound of cobalt chloride, glycerine and water—for some of his intelligence reports back to America. Even more useful to him later was a "sympathetic stain" created for secret communications by James Jay, a physician and the brother of John Jay. Dr. Jay, who had been knighted by George III, used the "stain" for reporting military information from London to America. Later he supplied quantities of the stain to George Washington at home and to Silas Deane in Paris.
The stain required one chemical for writing the message and a second to develop it, affording greater security than the ink used by Deane earlier. Once, in a letter to John Jay, Robert Morris spoke of an innocuous letter from "Timothy Jones" and the "concealed beauties therein," noting "the cursory examinations of a sea captain would never discover them, but transferred from his hand to the penetrating eye of a Jay, the diamonds stand confessed at once."
Washington instructed his agents in the use of the "sympathetic stain," noting in connection with "Culper Junior" that the ink "will not only render his communications less exposed to detection, but relieve the fears of such persons as may be entrusted in its conveyance." Washington suggested that reports could be written in the invisible ink "on the blank leaves of a pamphlet... a common pocket book, or on the blank leaves at each end of registers, almanacks, or any publication or book of small value."
Washington especially recommended that agents conceal their reports by using the ink in correspondence: "A much better way is to write a letter in the Tory stile with some mixture of family matters and between the lines and on the remaining part of the sheet communicate with the Stain the intended intelligence."
Even though the Patriots took great care to write sensitive messages in invisible ink, or in code or cipher, it is estimated that the British intercepted and decrypted over half of America's secret correspondence during the war.

Codes and ciphers

American Revolutionary leaders used various methods of cryptography to conceal diplomatic, military, and personal messages.
John Jay and Arthur Lee devised dictionary codes in which numbers referred to the page and line in an agreed-upon dictionary edition where the plaintext could be found.
In 1775, Charles Dumas designed the first diplomatic cipher that the Continental Congress and Benjamin Franklin used to communicate with agents and ministers in Europe. Dumas's system substituted numbers for letters in the order in which they appeared in a preselected paragraph of French prose containing 682 symbols. This method was more secure than the standard alphanumeric substitution system, in which a through z are replaced with 1 through 26, because each letter in the plain text could be replaced with more than one number.
The Culper Spy Ring used a numerical substitution code developed by Major Benjamin Tallmadge, the network's leader. The Ring began using the code after the British captured some papers indicating that some Americans around New York were using "sympathetic stain." Tallmadge took several hundred words from a dictionary and several dozen names of people or places and assigned each a number from 1 to 763. For example, 38 meant attack, 192 stood for fort, George Washington was identified as 711, and New York was replaced by 727. An American agent posing as a deliveryman transmitted the messages to other members of the Ring. One of them, Anna Strong, signaled the message's location with a code involving laundry hung out to dry. A black petticoat indicated that a message was ready to be picked up, and the number of handkerchiefs identified the cove on Long Island Sound where the agents would meet. By the end of the war, several prominent Americans—among them Robert Morris, John Jay, Robert Livingston, and John Adams—were using other versions of numerical substitution codes.
The Patriots had two notable successes in breaking British ciphers. In 1775, Elbridge Gerry and the team of Elisha Porter and the Rev. Samuel West, working separately at Washington's direction, decrypted a letter that implicated Dr. Benjamin Church, the Continental Army's chief surgeon, in espionage for the British.
In 1781, James Lovell, who designed cipher systems used by several prominent Americans, determined the encryption method that British commanders used to communicate with each other. When a dispatch from Lord Cornwallis in Yorktown, Virginia, to General Henry Clinton in New York was intercepted, Lovell's cryptanalysis enabled Washington to gauge how desperate Cornwallis's situation was and to time his attack on the British lines. Soon after, another decrypt by Lovell provided warning to the French fleet off Yorktown that a British relief expedition was approaching. The French scared off the British flotilla, sealing victory for the Americans.

Intercepting communications

The Continental Congress regularly received quantities of intercepted British and Tory mail. On November 20, 1775, it received some intercepted letters from Cork, Ireland, and appointed a committee made up of John Adams, Benjamin Franklin, Thomas Johnson, Robert Livingston, Edward Rutledge, James Wilson and George Wythe "to select such parts of them as may be proper to publish." The Congress later ordered a thousand copies of the portions selected by the Committee to be printed and distributed. A month later, when another batch of intercepted mail was received, a second committee was appointed to examine it. Based on its report, the Congress resolved that "the contents of the intercepted letters this day read, and the steps which Congress may take in consequence of said intelligence thereby given, be kept secret until further orders." By early 1776, abuses were noted in the practice, and Congress resolved that only the councils or committees of safety of each colony, and their designees, could henceforth open the mail or detain any letters from the post.
When Moses Harris reported that the British had recruited him as a courier for their Secret Service, General Washington proposed that General Schuyler "contrive a means of opening them without breaking the seals, take copies of the contents, and then let them go on. By these means we should become masters of the whole plot." From that point on, Washington was privy to British intelligence pouches between New York and Canada.

Technology

Dr. James Jay used the advanced technology of his time in creating the invaluable "sympathetic stain" used for secret communications. Perhaps the American Patriots' most advanced application of technology was in David Bushnell's Turtle, a one-man submarine created for affixing watchwork-timed explosive charges to the bottom of enemy ships.
The "turtle," now credited with being the first use of the submarine in warfare, was an oaken chamber about five-and-a-half feet wide and seven feet high. It was propelled by a front-mounted, pedal-powered propeller at a speed of up to three miles per hour, had a barometer to read depth, a pump to raise or lower the submarine through the water, and provision for both lead and water ballast.
When Bushnell learned that the candle used to illuminate instruments inside the "turtle" consumed the oxygen in its air supply, he turned to Benjamin Franklin for help. The solution: the phosphorescent weed, foxfire. Heavy tides thwarted the first sabotage operation. A copper-clad hull which could not be penetrated by the submarine's auger foiled the second. The secret weapon would almost certainly have achieved success against a warship if it had not gone to the bottom of the Hudson River when the mother ship to which it was moored was sunk by the British in October 1776.
An early device developed for concealing intelligence reports when traveling by water was a simple weighted bottle that could be dropped overboard if there was a threat of capture. This was replaced by a wafer-thin leaden container in which a message was sealed. It would sink in water, and melt in fire, and could be used by agents on land or water. It had one drawback—lead poisoning if it was swallowed. It was replaced by a silver, bullet-shaped container that could be unscrewed to hold a message and which would not poison a courier who might be forced to swallow it.

Intelligence analysis and estimates

On May 29, 1775, the Continental Congress received the first of many intelligence estimates prepared in response to questions it posed to military commanders. The report estimated the size of the enemy force to be encountered in an attack on New York, the number of Continental troops needed to meet it, and the kind of force needed to defend the other New England colonies.
An example of George Washington's interest in intelligence analysis and estimates can be found in instructions he wrote to General Putnam in August 1777:"Deserters and people of that class always speak of number.... Indeed, scarce any person can form a judgement unless he sees the troops paraded and can count the divisions. But, if you can by any means obtain a list of the regiments left upon the island, we can compute the number of men within a few hundreds, over or under." On another occasion, in thanking James Lovell for a piece of intelligence, Washington wrote: "It is by comparing a variety of information, we are frequently enabled to investigate facts, which were so intricate or hidden, that no single clue could have led to the knowledge of them.... Intelligence becomes interesting which but from its connection and collateral circumstances, would not be important."
Colonel David Henley, Washington's intelligence chief for a short period in 1778, received these instructions when he wrote to Washington for guidance: "Besides communicating your information as it arises.... you might make out a table or something in the way of columns, under which you might range, their magazines of forage, grain and the like, the different corps and regiments, the Works, where thrown up, their connexion, kind and extent, the officers commanding, with the numbers of guns &ca. &ca. This table should comprehend in one view all that can be learned from deserters, spies and persons who may come out from the enemy's boundaries."

Notable individuals involved in espionage during American Revolutionary War