He made a number of films in the 1950s with his wife, actresss and director Ida Lupino, to whom he was married until 1984. In the 1960s, Duff turned to television to find good roles. He starred in a number of TV shows, including Felony Squad, Knots Landing, and Dallas. He passed away in 1990 at the age of 76.