Smith is a former NFL football player who played for the Baltimore Colts and the New York Giants. He played college football at Auburn University where he was awarded the Outland Trophy in 1958. His banner, along with four other Auburn greats (Bo Jackson, Pat Sullivan, Tracy Rocker and Carlos Rogers) is hanging outside Jordan-Hare Stadium in his honor. He was drafted in the fourth round of the 1959 NFL Draft.