In 939, Muhammad became ill and Abu Ali was assigned to succeed him in his posts. As governor of Khurasan he undertook several campaigns in northern Iran, conquering Gurgan and territory as far west as Ray from the Ziyarids, forcing the Ziyarids to acknowledge Samanid authority, and killing the Dailamite adventurer Makan ibn Kaki. After he departed for Khurasan the BuyidRukn al-Dawla seized Ray. In 945 Abu Ali returned and expelled the Buyids from Ray, but they returned a year later. That same year, 945, the Samanid amir Nuh I dismissed Abu Ali from the governorship of Khurasan after hearing complaints of the latter's harsh rule, and sought to replace him with a Turk, the SimjuridIbrahim ibn Simjur. Abu Ali refused to accept his dismissal and rebelled. He was joined by several prominent Iranian figures such as Abu Mansur Muhammad, whom he appointed as the commander of Khurasan. Abu Ali also convinced a Samanid, Nuh's uncle Ibrahim ibn Ahmad, to come fromIraq and installed him as amir in Bukhara when he took the city in 947. Abu Ali, now having secured his position, returned to Chaghaniyan. Ibrahim, however, was unpopular with the people of Bukhara, and Nuh soon retaliated by retaking the city and blinding Ibrahim and two brothers. When the news of the re-capture of Bukhara arrived to Abu Ali, he once again marched towards Bukhara, but was defeated by an army sent by Nuh and withdrew back to Chaghaniyan. After some time, he left the region and tried to obtain support from other Samanid vassals. Meanwhile, Nuh had Chaghaniyan ravaged and its capital sacked. Another battle shortly ensured between Abu Ali and a Samanid army in Tukharistan, which resulted in a Samanid victory. Fortunately for Abu Ali, he managed to secure the support of other Samanid vassals, such as the rulers of Khuttal, and the Kumiji mountain people, and in the end made peace with Nuh, who allowed him to keep Chaghaniyan in return for sending his son Abu'l-Muzaffar Abdallah as hostage to Bukhara. Some time later, Abu Ali was sent on an expedition to quell a rebellion near Chaghaniyan under a self-proclaimed prophet known as Mahdi. Abu Ali managed to successfully defeat and capture the latter and then had his head sent to Bukhara. In ca. 951/2, Abu Ali's son Abu'l-Muzaffar Abdallah died in an accident and his corpse was shortly sent to Chaghaniyan, where he was buried. In 952 following the death of the governor of Khurasan, Mansur ibn Qara-Tegin, 'Abu Ali was reinstated by Nuh as governor of the province. At the insistence of the Ziyarids he began a war with the Buyid Rukn al-Dawla, but was unable to take Ray and made peace. This action upset Nuh, who again removed him from the governorship. 'Abu Ali fled to the Buyids and received an investiture diploma for Khurasan from the Caliph and was even reinforced by an army under Lashkarwarz, but was unable to enforce his claim or even return to Chaghaniyan. In 955 he and one of his sons died of the plague in Ray. Their bodies were shortly brought to Chaghaniyan where they were buried. A certain Muhtajid prince, Abu'l Muzaffar ibn Muhammad, probably the grandson of 'Abu Ali, was then appointed as the new ruler of Chaghaniyan. However, according to some other sources, Abu Ali was succeeded by his relative Abu'l-Hasan Taher.