Prior to playing professionally, Richardson played at the college level for Brown University. While at Brown he was a two-time All-American on Walter Camps second team. He is best known as the player who kicked Brown’s first ever field goal in 1899. In 1898 he earned his first All-American status by running 103 yards for a touchdown against Princeton.
In 1971 Willis was inducted into the Brown University Football Hall of Fame.