The southern terminus of National Route 4 lies at Nihonbashi, the kilometer zero of Japan in Chūō, Tokyo. The marker here signifies the terminus of national highways including National Route 1, National Route 6, National Route 14, National Route 15, National Route 17, and National Route 20. Of the mentioned highways, three travel concurrently with National Route 4 from Nihonbashi: National Routes 6, 14, and 17. Just north of the starting point, National Route 17 leaves the concurrency continuing north while National Route 4, along with National Routes 6 and 14, turn east on to Edo-dōri. Three blocks from there Edo-dōri intersects Shōwa-dōri. National Route 4 turns on to Shōwa-dōri leaving the Edo-dōri concurrency with National Routes 6 and 14. Traveling north along Showa-dōri, National Route 4 serves as a frontage road to the Ueno Route of the Shuto Expressway system between Chūō and Taitō. The Ueno Route merges in to National Route 4 just to the northeast of Ueno Station. The highway then crosses over the Sumida River into Adachi. From the northern side of the river to Utsunomiya, the highway is known as the Nikkō Kaidō. In the ward the highway crosses beneath the Central Circular Route of the Shuto Expressway system, with an interchange with the expressway's frontage road. National Route 4 travels north through Adachi, roughly paralleling the Tobu Skytree Line. It then curves to the northwest, crossing over the Kena River into the city ofSōka in Saitama Prefecture.
National Route 4 was preceded by the Tōsandō, a road initially established during the Asuka period as a road linking Kinai to what is now the vicinity of Morioka, Iwate. The portion of the Tōsandō that was later incorporated into National Route 4 lies between Tochigi Prefecture and Iwate Prefecture. The next development of the route came along with the creation of the Ōshū Kaidō and Nikkō Kaidō as two of the five routes of the Edo period. They were established by Tokugawa Ieyasu for government officials traveling through the area to connect Edo with Mutsu Province and the present-day city of Shirakawa, Fukushima Prefecture, Japan. There were also many roads that connected to the Ōshū Kaidō that are included in National Route 4. One such sub-route was the Sendaidō, which connected Mutsu Province with Sendai. From Sendai, the Matsumaedō connected Sendai with Cape Tappi and indirectly to Hakodate on the southern shore of Hokkaido on the Tsugaru Strait. Though the Ōshū Kaidō has only 27 post stations, there were over 100 designated post stations when the subroutes are included. Some sections and markers of the Ōshū Kaidō in their original state can still be found alongside National Route 4, the Hachinohe Expressway, and Tōhoku Expressway. On 4 December 1952 First ClassNational Highway 4 was established. The route was reclassified as a General National Highway on 1 April 1965. During the 2011 Great East Japan Earthquake many sections of the route in the Tōhoku area were damaged.