Born in Midland, Texas, Patterson graduated from Lincoln High School in Camden, Arkansas in 1966. He enrolled at nearby Ouachita Baptist University, in Arkadelphia, Arkansas in the fall of 1966, playing basketball for Coach Bill Vining. Patterson was a classmate of NFL All-Pro Cliff Harris at Ouachita Baptist, then an NAIA college. However, after his freshman year, Patterson joined the U.S. Army, where he subsequently served three years, including one year of duty in Vietnam. When he finished his service with the US Army, Patterson returned to Ouachita Baptist in the fall of 1970 and rejoined the basketball team. Returning to Ouachita Baptist in 1970, Patterson averaged 20.5 points and 12.5 rebounds in 1970-1971 under Coach Vining. In 1971-1972, Patterson averaged 25.3 points and 14.7 rebounds as Ouachita Baptist advanced to the second round of the 1972 NAIA Men's Basketball Tournament. For his college career he averaged 23.1 points, 13.8 rebounds, shooting 52.2% from the field and 73.5% from the foul line. As he had originally enrolled in college in 1966, Patterson was eligible for the 1972 NBA draft, held on April 10, 1972. A 6'6" power forward, Patterson was selected by the Baltimore Bullets in the second round with the 25th overall pick. The Bullets had received the draft pick spot earlier in the day in a trade with the Phoenix Suns for eventual Naismith Basketball Hall of Fame inductee Gus Johnson. In his rookie season with the Bullets, Patterson averaged 2.4 points and 1.0 rebounds, averaging four minutes in 29 games. He played under Coach Gene Shue and alongside Hall of Fame inductees Wes Unseld and Elvin Hayes. The Bullets won the Central Division with a record of 52-30 and were eliminated by the eventual NBA ChampionNew York Knicks in the first round of the NBA Playoffs. Patterson played sparingly in the playoffs. Patterson played in only two games for the Bullets in the 1973-1974 season, before being waved on November 26, 1973. Patterson played with the New York Nets of the American Basketball Association in the 1974-1975 pre-season under Coach kevin Loughery. The Nets were defending ABA Champions. Patterson played alongside Hall of FamerJulius Erving with the Nets, but Patterson was cut and did not appear in a regular season game.
Patterson was inducted into the Ouachita Baptist University Athletics Hall of Fame in 2015. His daughter Kelana was present to represent Patterson for his induction.