Carlson was born in 1893 near Concordia, Kansas, the son of Anna and Charles Eric Carlson, both Swedish immigrants. He attended public schools and Kansas State University before serving in World War I as a Private. After the war, he returned to Concordia to farm. He was elected as a Republican to first the Kansas House of Representatives in 1928 and then to the United States House of Representatives where he served from 1935-47. In 1946 he was elected governor of Kansas. As governor, he pushed mental health programs as well as a long-term highway project. In 1949, Kansas State Senator Clyde M. Reed died, and Carlson appointed Harry Darby to fill the seat. Darby continued his service in the Senate until Carlson himself was elected to fill the seat in 1950. Instead of waiting until January to be sworn in, he took his seat on November 28, 1950 leaving the office of governor to Frank L. Hagaman who served less than two months. In 1952, he campaigned to get fellow Kansan Dwight D. Eisenhower into the White House, and then brokered a deal through Ohio Senator Robert A. Taft and became majority leader. According to Billy Graham's biography Just As I Am, Carlson invited Eisenhower to the Senate Prayer Breakfast, which thus became the first Presidential Prayer Breakfast, thereafter an annual assembly of all three branches of government, continuing to this day. Carlson was re-elected twice, in 1956 and 1962, before returning to Concordia for retirement. Senator Carlson served a term as president of the United States Senate Prayer Breakfast Group. He was therein featured by U.S. News & World Report on July 1, 1968, by editor, David Lawrence, for his strong moral and spiritual influence in the nation's capital. He was also a member of the board of directors of World Vision. Carlson voted in favor of the Civil Rights Acts of 1957, 1964, and 1968, as well as the 24th Amendment to the U.S. Constitution, the Voting Rights Act of 1965, and the confirmation of Thurgood Marshall to the U.S. Supreme Court, but did not vote on the Civil Rights Act of 1960.
In April 2011, the Frank Carlson Library in Concordia, Kansas, received a mini grant from the Kansas Humanities Council to renovate the library's Frank Carlson Room. The grant funded the development of a new exhibit dedicated to telling new generations of Kansans about Carlson's life and political career. Coinciding with the yearlong Kansas 150 Commemoration, the renovation was part of a statewide initiative to preserve the memory of important people and events in the state's past. Senator Frank Carlson is the only Kansan to have held four major public offices and is known as "Kansas' Favorite Son". The renovation project replaced the original Frank Carlson display, created in 1976 and shown until the summer of 2011. The new exhibit, Frank Carlson: Prairie Politician, tells and preserves Senator Carlson's story through an updated exhibit and modern archival techniques. The exhibit showcases Carlson memorabilia, photographs, and items from the Senator's personal collection, which is housed in the Frank Carlson Library. Senator Carlson's story is told in three parts, beginning with his childhood and church leadership in Concordia, Kansas, following him through his forty-year political career, and celebrating his legacy as a political figure and an important local figure. Among the items on display are a check from President Dwight D. Eisenhower, written to Carlson in settlement of a friendly bet, several pens used by President Lyndon B. Johnson to sign important legislation that Carlson supported, and Carlson's elephant figurine collection. The exhibit also includes artifacts that tie Carlson to his hometown and home state. On display are the school bell from the schoolhouse Carlson attended in Cloud County, Kansas, caricatures and political cartoons drawn by fellow Concordian Don Musik, and keepsakes on loan from Carlson's friends and family.