Before finding fame in acting, Davis worked as a Songwriter, most famously penning The Jackson 5's No. 2 hit "Never Can Say Goodbye." He appeared on Broadway as Valentine in Galt MacDermot and John Guare's musical Two Gentlemen of Verona, based on the Shakespeare comedy of that name. He starred as barber Clifton Curtis in the mid-1970s television show That's My Mama with Theresa Merritt, Theodore Wilson and Ted Lange.

Davis' romantic interest with songstress and Broadway performer Melba Moore led to his co-starring role on her musical variety television show. Later he made a guest appearance on the third episode of the first season of The Bobby Vinton Show in September 1975, singing "I've Got The Music In Me" and "Never Can Say Goodbye." He successfully sang the Polish lyrics with Vinton to the show's "My Melody of Love" theme song.

A triple heart bypass survivor, he participated in the "superstars" Celebrity TV Sports competitions of the seventies, in addition to making several appearances on the popular Celebrity game show Match Game. He also appeared in the film Scott Joplin in 1977. He also made numerous appearances on several incarnations of Pyramid from the early 1970s to the early 1990s.

From 1986 to 1991, he co-starred with Sherman Hemsley, as the Reverend Ruben Gregory, in the NBC sitcom Amen, which ran for five seasons. Davis released one acclaimed (and now hard to find) studio recording in 1991 on Benson Records titled Say Amen. He also played the mayor of Miami in the 1999 film Any Given Sunday. Davis has continued his stage work, starring in Toronto and on Broadway in Aladdin, playing the Sultan of Agrabah.

Davis holds a BA in Theology from Oakwood University and a Master of Divinity degree from Andrews University. From 1987 to 1989, he was an Associate Pastor of the Loma Linda University SDA Church in southern California. For the last 25 years he has been an active part of Youthville, USA a children's services organization. He served as co-founder and co-pastor of Welcome Christian Center in Huntington Beach, California. Davis is a licensed minister by St. Luke Baptist Church, New York, New York. He has had an interdenominational ministry for over 30 years. He has served as National Spokesperson and Advisory Board Chairman. He is the emcee and host of The Most Soulful Sound, an annual gospel choir competition in Raleigh, North Carolina. He also hosts an annual Celebrity golf tournament in Elizabeth City, NC at Elizabeth City State University, where he served as Vice Chancellor for Institutional Advancement. Since the end of 2005 Davis has held the position of Executive Director for Welcome America, a non-profit organization located in Philadelphia, Pennsylvania that produces the largest Fourth of July celebration each year in the nation. Davis is a frequent guest host on Trinity Broadcasting Network. Davis also hosted the Gospel Superfest TV show from 2000 to 2008, which is syndicated by United Television. Davis is the author of an autobiographical essay entitled "A Mason Dixon Memory" in which he recounts his experiences as an eighth grader dealing with prejudice on a trip to a southern state.