Patterson started 10 games as a true freshman at Southeast Missouri State University in 2001. He earned second-team All-OVC honors at cornerback in 2002 as a sophomore. In 2003, he led the Ohio Valley Conference in interceptions and pass breakups, and also had three forced fumbles. Patterson earned first team OVC that year, as well as making two NCAA Division I-AA All-American teams. He was a 2004 Lindy's preseason All-American Team and a first Team All-SIAC pick. He returned two blocked field goals for touchdowns and one blocked PAT attempt for two points. His team won ten games and lost two and played in the 2004 Pioneer Bowl.
Patterson signed with the Washington Redskins as an undrafted free agent in 2005. He joined their practice squad on September 5, 2005. He was then promoted to the 53 man roster on October 2, 2005, but was released two days later and returned to the practice squad. Patterson split the season on the active roster 8 weeks and on the practice squad 8 weeks. In his first series on defense as a rookie Patterson intercepted a Drew Bledsoe pass intended for Keyshawn Johnson and returned it for 20 yards.
Patterson joined the Kansas City Chiefs in 2007 grading out as their best special team performer. He was released by the team on October 30, 2008.
Philadelphia Eagles
Patterson was signed by the Philadelphia Eagles on January 7, 2009 after guardMike McGlynn was placed on injured reserve. In the 2009 season, Patterson appeared in 10 games as a core special teams player. In 2010 Patterson had the best season of his career as the teams most productive special teamer through the first 8 weeks leading the Eagles in special team tackles with 10. Patterson was then inserted into the starting lineup against Peyton Manning's Indianapolis Colts at cornerback week 9 replacing Ellis Hobbs. Patterson ended the season with career highs in interceptions, pass deflections,, Sacks, FF, TD's
Cleveland Browns
On August 2, 2011, Patterson signed a one-year 3.6 million dollar contract with the Cleveland Browns. Patterson had success for the Browns in which he played a vital role in Cleveland's secondary being ranked 2nd in the NFL in Pass Defense which prompted the Browns to re-sign him to a multi-year contract. On December 17, 2012, the Cleveland Browns surprisingly released him.
Miami Dolphins
Patterson was claimed off waivers by the Miami Dolphins on December 18, 2012. 2013 Patterson was hampered by a nagging groin injury all season but still managed to tie for a team high 4 interceptions in only 6 appearances. Patterson later underwent surgery on his groin at the end of the season. He was released by the Dolphins on the day beforefree agency began on March 10, 2014.
New York Jets
Patterson was signed by the New York Jets on April 1, 2014. On August 25, 2014, Patterson was suspended indefinitely by the Jets, after leaving the team without contacting the organization allegedly. Patterson later gave a statement saying the Jets were properly notified by his agent Drew Rosenhaus. He was released on August 30, 2014. Patterson retired in 2014.