When his mother died during the flu epidemic of 1919, his father placed Victor and his younger sister, Rosemary, in a children's shelter, and returned to his homeland to seek another wife. His father returned in 1922, with his new wife Lovi Shee, once again forming a household with his two children. During his acting career, Victor was given billing under a variety of names, including Sen Yung, Sen Young, Victor Sen Young, and Victor Young.

Sen Yung made his first significant acting debut in the 1938 film Charlie Chan in Honolulu, as the Chinese detective's "number two son," Jimmy Chan. In this movie, Sidney Toler replaced the recently deceased Warner Oland as Charlie Chan and Sen Yung replaced Oland's "number one son" Lee, who had been played by Keye Luke. Sen Yung played Jimmy Chan in 10 Charlie Chan films between 1938 and 1942. He played the crucial role of lawyer's clerk Ong Chi Seng alongside Bette Davis in The Letter (1940).

In Common with other Chinese-American actors, Sen Yung was cast in Japanese parts during World War II, such as his role as the treacherous Japanese-American Joe Totsuiko in the 1942 Humphrey Bogart film Across the Pacific.

After the war, Sen Yung resumed his Hollywood career. The Charlie Chan series was now in the hands of Monogram Pictures, with Sidney Toler continuing in the leading role. Toler's health was failing by 1946; author Scott MacGillivray contends that Monogram was conserving Toler's Energy and shooting around him wherever possible, even reusing two-year-old footage to finish Toler's last film. To relieve the burden on Toler, Monogram hired his original screen foil, Sen Yung (now billing himself as Victor Sen Young). He and Mantan Moreland shared the spotlight in Toler's final two films, Shadows over Chinatown and The Trap.

Following Toler's death in 1947, Victor Sen Young continued to work in motion pictures but also moved into television, playing affable or earnest Asian characters. He is probably best remembered as Hop Sing, the cook on the long-running television series Bonanza, appearing in 102 episodes between 1959 and 1973.

In 1972, Yung was on Pacific Southwest Airlines FLIGHT 710, which was hijacked. The FBI stormed the plane, and in the ensuing gunfire Sen Yung was shot in the small of the back. He and another wounded Passenger survived, but a third Passenger and the two hijackers were killed.

Sen Yung was also an accomplished and talented chef. He frequently appeared on cooking programs, and authored The Great Wok Cookbook in 1974.

In 1975, he appeared on Garry Moore's To Tell The Truth show and related the events of the hijacking. With Yung dressed in a sport coat and flanked by two dissimilar imposters, none of the four panelists was able to choose him as the character actor.

Victor Sen Yung died under unusual circumstances in his North Hollywood home in 1980. The actor, who ran a small mail-order Chinese pottery Business, was creating clayware and curing the items with an oven, and died of natural gas poisoning from a gas leak. His body was found November 10, but he had reportedly been dead at least ten days.