Vidmer's father played college football as a guard at Villanova University in the 1930s. The younger Vidmer was a native of Greensburg, Pennsylvania and grew up in western Pennsylvania, which Vidmer described as "a peculiar place, where you have a lot of small towns within 10-15 miles of each other, and football is simply the sport throughout the area." He attended Hempfield Area High School, where he was one of the finest prep quarterbacks ever produced in the State of Pennsylvania. He was also president of the student council and had grades that won him admission to Harvard. In a 1966 interview, he described his college selection process as follows:
"Yea. I was accepted at Harvard. My dad was really fired up for Ivy League -- you know, prestige and ivy covered walls... I visited Harvard and Princeton and got an idea about that, and then I visited Purdue and MSU too and I kinda got the idea that I wanted a school that played good football, but also offered a good academic program. Ivy League football leaves a lot to be desired... and MSU is a little short on academics. So I came here and haven't been sorry a minute."
University of Michigan
As a freshman in 1964, Vidmer suffered a broken leg and torn ankle ligaments during a football practice session. Vidmer never recovered fully from the injury, recalling later, "I was never able to move around like I could before. It made a difference in my effectiveness. I was not as formidable a player as I once was." He started only three games in the 1965 season, completing 32 of 68 passes with seven interceptions. In 1966, Vidmer was Michigan's starting quarterback in nine of its ten games. In the opening game of the 1966 season, he threw for 258 passing yards, a Michigan single-game record. Five weeks later, he completed 15 of 19 passes for 210 yards and three touchdowns in a 49-0 victory over Minnesota and was selected as the UPI Midwest Back of the Week. His total of 117 pass completions in 1966 set a new Michigan single-season record. Vidmer was also selected as an Academic All-American in 1966. Vidmer also started four games at quarterback for the 1967 Wolverines. In his three years at Michigan, he completed 187 of 382 passes for 2,455 yards, 11 touchdowns, and 20 interceptions. Vidmer received three degrees from Michigan, a bachelor's degree in economics, a master's degree in Soviet government and politics, and a Ph.D. in Soviet management theory.