Ellis was drafted by the Hawthorn Football Club with their first selection and third overall in the 2005 national draft. In 2006, he focused on completing his year twelve studies and playing football for Melbourne Grammar, where he was co-captain of the 1st XVIII. His season was wrecked by injuries, but he managed to play several games for Hawthorn's VFL affiliate, the Box Hill Hawks. He made his senior debut against the in round one, 2007 and scored his first goal in round four against at Aurora Stadium. His debut season saw him rewarded with the club's best first year player. During the 2008 season, he played 23 matches, averaging 20 disposals. Xavier played in the 2008 AFL Grand Final, where he amassed 28 disposals and helped his team defeat Geelong. This would be his first and only Premiership as a player but he would go onto play in two more grand finals. From 2009 to 2012, he was hampered by a string of injuries throughout this period. He missed most of the 2012 season, only managing to play five matches, including the 2012 grand final loss. This would Xavier's second Grand Final appearance and first loss as a player. In 2013, he was restricted to just two games after numerous calf injuries and at the end of the season he signed with the as an unrestricted free agent. This would be the same time former Hawthorn Football Club Assistant Coach Adam Simpson would become West Coast Eagles Head Coach. From 2014 to 2015, he played the majority of both seasons including the 2015 AFL Grand Final against his old side, Hawthorn. This would Xavier's third grand final appearance and second loss as a player. After managing just two matches in the 2016 season, Ellis announced his immediate retirement from the AFL in August via a post on Instagram.
Media
In February 2017, Ellis was announced as co-host of Weekend Breakfast on Hit 92.9 with Heidi Anderson. In January 2018, Ellis was announced at co-host of Heidi, Xavier and Ryan, Hit 92.9's Weekday breakfast program with Heidi Anderson and Ryan Jon. Throughout the 2018 WAFL season Xavier was seen on the Channel Seventelevision coverage. The following year, Ellis would replace Peter Bell for Channel Seven's coverage of AFL matches in Perth. His role has been primarily as a boundary rider and to conduct interviews during the quarter breaks. In June 2018, Ellis admitted on radio that he was significantly fat.
