A native of Cookeville, Tennessee, Brown was one of the top-rated quarterbacks in the nation coming out of high school. He was also recruited to play basketball and was drafted by the Pittsburgh Piratesbaseball team as a shortstop. He chose to stay in state and played as a quarterback at Vanderbilt University from 1969 to 1972. He started all four years at Vandy and led the Commodores to their best seasons in terms of wins since 1960. One of his victories was a 14–10 upset over the #13 Alabama Crimson Tide in 1969. It was Vanderbilt's first victory over Alabama in 13 seasons.
Coaching career
After graduating from Vanderbilt, Brown spent the 1973 season as a graduate assistant at his alma mater. From there, he went to East Carolina University, where he spent two seasons as an assistant to Pat Dye, coaching quarterbacks and wide receivers. In 1976 and 1977, he served as the offensive coordinator at Jacksonville State University. The Gamecocks played for the NCAA Division II Football Championship in 1977. Brown spent the 1978 season as an assistant at Texas Tech University under Rex Dockery before landing his first head coaching position a year later. At age 29, he began a two-year stint as the head coach at Austin Peay State University. The Governors had a record of 14–8 under Brown. In 1981, Brown returned to Vanderbilt to become the school's offensive coordinator. Two seasons later, he took his first major college head coaching job, taking over the program at the University of Cincinnati. In one season with the Bearcats, he had a record of 4–6–1. In 1984, Brown was named head football coach and athletic director at Rice University. In two seasons with the Owls, he compiled a record of 4–18. From there he returned to his alma mater to take over the struggling Vanderbilt University football program. Brown's five-year stint with the Commodores from 1986 to 1990 produced a record of 10–45. After leaving Vanderbilt, Brown spent the 1991 and 1992 seasons as the offensive coordinator at Mississippi State University under Jackie Sherrill, then the 1993 and 1994 seasons with the same responsibilities at the University of Oklahoma under Gary Gibbs. In 1995, Brown was hired by the University of Alabama at Birmingham to lead the fledgling program as it prepared to move from NCAA Division I-AA to Division I-A. In 12 seasons as the head coach of the Blazers he compiled a record of 62–74 and led the team to its first bowl game appearance, in the 2004 Hawaii Bowl. Brown resigned from UAB to take over the head coaching responsibilities at Tennessee Technological University on December 9, 2006. Brown is the first coach in NCAA football history to lose 200 games. With Tennessee Tech's 50–7 loss on September 27, 2014, Brown eclipsed Amos Alonzo Stagg's mark of 199 losses. On December 2, 2015, Brown announced his retirement as coach at Tennessee Tech. As of September, 2019, Brown is the co-host of The George Plaster Show on Nashville radio station WNSR weekdays from 2-4 pm.