Jack Soo was born Goro Suzuki on a ship traveling from Japan to the United States in 1917. He lived in Oakland, California until ordered into internment along with other Japanese Americans during World War II. He was sent to the Topaz War Relocation Center in Utah and fellow internees recalled him as a "camp favorite", an entertainer singing at dances and numerous events.

Soo finally earned his big break in 1958 when he was cast in the Broadway musical hit Flower Drum Song in the role of the show M.C. and Comedian Frankie Wing ("Gliding through my memoree"). He was working in San Francisco at the Forbidden City, a Chinese nightclub and cabaret, which was portrayed in the musical and movie. He was offered the chance to go to Broadway on the condition that he change his name to something Chinese, as Flower Drum Song is set in San Francisco's Chinatown. At that time, he adopted the surname that he had used to leave the internment camp at Topaz, "Soo." Jack switched to the Sammy Fong role (Chinatown's "Nathan Detroit") during the run and played the role when the film version (1961) of the musical was made.

Soo was first broadcast across America by Jack Benny on November 27, 1962, as the street-wise talent agent in "Jack Meets Japanese Agent". In 1964, Soo played an important weekly supporting role as a poker-playing con Artist in Valentine's Day, a one-season comedy television series starring Anthony Franciosa. During the next decade, he would appear in films such The Green Berets as a colonel of the Army of the Republic of Vietnam and the 1967 musical Thoroughly Modern Millie, as well as making guest appearances on TV shows such as Hawaii Five-O, The Odd Couple, and two episodes of M*A*S*H.

Soo joined Motown Records in 1965 as one of their first non-African American artists. During his time there, he recorded a slow ballad version of "For Once in My Life" as the first male singer to do so. The record was never released and was shelved in the Motown archives. The song was soon after made famous by Stevie Wonder.

Soo was cast in his most memorable role in 1975 on the ABC sitcom Barney Miller as the laid-back, but very wry, Detective Nick Yemana, who was responsible for making the dreadful coffee that, in one of the series' running jokes, his fellow detectives had to drink every day.

Soo was diagnosed with esophageal cancer during Barney Miller's fifth season (1978–79). The cancer spread quickly, and Soo died on January 11, 1979, at age 61, at the University of California at Los Angeles Medical Center (now the Ronald Reagan UCLA Medical Center). His last appearance on the show was in the episode entitled "The Vandal," which aired on November 9, 1978.