Chai was named chief financial officer of Chicago, Illinois-based electronic communication network company Archipelago Exchange in June 2000. Chai was a major driving force behind the merger between Archipelago and the New York Stock Exchange; he repeatedly pressured his boss Archipelago CEO Gerald Putnam, to meet with NYSE officials, though Putnam felt that the NYSE would be uninterested and hoped instead to pursue an acquisition of rival ECN Instinet. In April 2005, when Archipelago formally announced its pending acquisition by the NYSE, it was decided that Chai would take over as CFO of the NYSE in May 2006 from Amy Butte, who had held that position since February 2004. Butte later decided to leave the exchange entirely rather than continue at her planned new position as executive vice president of strategy and product development. In 2006, Chai received a salary of $750,000 and a bonus of $825,000 from the NYSE; combined with other payments, his cash compensation for the year totalled $2,168,922.
Merrill Lynch
On 3 December 2007, John Thain, the new chief executive officer at Merrill Lynch and Chai's former boss at the NYSE, announced that Chai would join Merrill in the position of chief financial officer starting on 10 December; the move was part of a management shake-up at Merrill, initiated due to their losses in the 2007 subprime mortgage financial crisis. Chai replaced Jeffrey Edwards, who had held the position of CFO since 2005; Thain stated Edwards would assume another unspecified role within Merrill. Chai's new employer revealed that he would receive a bonus of $2.5 million for the 2007 fiscal year, split evenly between cash and stock, for his three weeks of work that year, bringing his total compensation for the year to $3.1 million. Merrill justified the bonus by pointing out that Chai would not receive any year-end incentive payment from his previous employer. Chai was slated to receive a salary of $600,000 in 2008. However, he and other top-level Merrill executives received no bonus that year, due to the ongoing financial crisis.
When Bank of America acquired Merrill Lynch in late 2008, they named Chai to head their Asia business. BofA planned to relocate Chai to Hong Kong for his new position. He replaced Jason Brand, who had worked at BofA for 15 years. However, Chai departed from BofA in February, just two weeks after the ouster of Thain, and was replaced by Ki-Myung Hong. He had not yet relocated to Hong Kong at the time he quit. His departure left just one other member of Thain's management team in place at BofA, Tom Montag as head of sales and trading.
CIT Group
In early 2010, the CIT Group reportedly approached Chai about the CFO position there after they hired Thain as CEO. In June, they announced that Chai would be coming on board, but in the capacity of chief administrative officer and head of strategy instead. Chai's new responsibilities at CIT include global infrastructure and operating architecture, leadership of the insurance and consumer finance divisions, as well as business development and strategic planning. A little over a year later, in August 2011, he was named CIT's president; following the promotion, he would keep his prior responsibilities as CAO and head of strategy, and in addition would take charge of CIT's corporate finance and vendor finance businesses. His total compensation package for 2011 was $1.7 million, down by 40% from 2010, reflecting a broader downward trend in executive compensation packages at CIT to which the only exceptions were Thain himself and transportation division president Jeffrey Knittel.