Varcoe was given the honour of wearing Geelong's number five guernsey, previously worn by club legends Gary Ablett and Polly Farmer. Varcoe plays as a forward pocket but can also play as a midfielder if required, drawing comparisons to Melbourne speedster Aaron Davey, with his consistent forwardline pressure and high-speed chase downs on the field. Varcoe is often referred to as "The Magician" with his quick, at times invisible handballs and tricky skills. Varcoe played a key utility role for Geelong in 2009, which included a valuable contribution in the Grand Final as Geelong defeated the St Kilda Football Club. Varcoe played a critical role in delivering a handball to Paul Chapman late in the game which resulted in a brilliant Chapman goal, giving Geelong a six-point lead. Shortly after, team mate Max Rooke scored a goal after the final siren to give Geelong a 12-point win. Going into the 2010 AFL season, Varcoe put in the most promising preseason of his career, only to succumb to a thumb injury that put him out for the first few weeks of the season. However, on his return to the senior side, Varcoe played well enough to finish ninth in Geelong's 2010best and fairest count. Varcoe kicked the first goal of the 2011 AFL Grand Final inside the first 10 seconds of the match. He also kicked the second goal of the match, however his goal at the eight-minute mark in the 4th quarter was possibly goal of the season. Before kicking the goal Varcoe took a mark in Geelong's backline whilst he was almost simultaneously bumped, forcing the ball free and the mark going unpaid. However Varcoe then ran forward with the play, gathering possessions and ultimately converting a goal from inside 50 moments later. He would pick up his 2nd premiership medallion, as Geelong won by 36 points. As of Round 11, 2015, Varcoe had played in 149 games and, of those 149 games, had won 122 of those games. He was also the quickest player to reach 100 wins, playing in his 100th win in his 113th game.
On 15 October 2014, Varcoe was traded to the Collingwood Football Club in a three-way trade between Collingwood, Geelong and Melbourne which also saw Mitch Clark and Heritier Lumumba find new clubs. Despite being considered past his best during his last year at Geelong, Varcoe has enjoyed a renaissance of form since moving to Collingwood, playing arguably the best football of his career. Varcoe was considered one of the best recruits of the 2015 season.
Personal life
In August2007, Varcoe caused controversy after concerns were raised about the racial and sexual content featured on his MySpace page.. The Geelong Football Club acted swiftly, removing the content immediately after it came to its attention.