Rafferty played collegiate football at Penn State University under legendary coach Joe Paterno. Upon graduation he became a Dallas Cowboy.

Rafferty played in two Super Bowls including a victory in Super Bowl XII. He played in 203 games total, started 188 of those and held a longtime record for 167 consecutive starts. Rafferty was inducted into the Greater Syracuse Hall of Fame.