He then played for and was assistant manager of, Swedish side Hagahöjdens BK, Norrköping. He returned to England in 1986, joining the coaching staff at Wimbledon. He was first team coach when Wimbledon won the FA Cup in 1988. He later took over as manager at Plymouth Argyle in March 1990. In July 1992, he took over as manager of Conference side Slough Town. He guided Slough to fifth place in the Conference, their highest-ever finish, but left at the end of his first season to become assistant manager at Crystal Palace under new manager Alan Smith where they won the 1993–94 League Championship, and reached the semi-finals of the League Cup and FA Cup in the 1994–95 season. He was appointed as assistant manager of Wycombe Wanderers, again under Smith, at the start of the 1995–96 season, leaving along with Smith after a poor start to the 1996–97 season. He then became assistant manager under John Docherty at Millwall and was later first-team coach at Wimbledon under Joe Kinnear until the summer of 1999 when he returned to Millwall as first-team coach. In December 1999, Kemp was appointed first-team coach at Portsmouth under new manager Tony Pulis. In October 2000, he was appointed as manager of Oxford United, with Joe Kinnear as Director of Football. Kinnear left to manage Luton Town in February 2001 and Kemp was dismissed two months later following relegation and protests by the Oxford fans. In December 2001, he was appointed as Chief Scout for Leicester City. Later that month he was named as one of the best 101 players to have played for Plymouth Argyle before joining Stoke City as first-team coach in August 2004, again working under Tony Pulis. Kemp left Stoke in June 2005 when Pulis was dismissed. In September 2005, Pulis took over as manager of Plymouth Argyle and again appointed Kemp as his assistant. Kemp remained in this post under new manager Ian Holloway until August 2006. In October 2006, he rejoined Stoke City as assistant manager, but became chief scout when Peter Reid was appointed as assistant manager. In July 2010, Reid left Stoke to become manager at Plymouth and Pulis again appointed Kemp as his assistant. Kemp remained as assistant to Pulis as Stoke earned automatic promotion to the Premier League in 2008. Stoke established themselves as a Premier League outfit during Kemp's time as assistant and finished as runners-up in the 2011 FA Cup. He left Stoke at the end of the 2012–13 season. He followed Pulis to Crystal Palace in January 2014 and then West Bromwich Albion in January 2015. Kemp left his position as Albion's Assistant Head Coach at the end of the 2016–17 season and retired from football after spending more than 40 years in the game. After a short break Kemp returned to football with Middlesbrough FC,