Re-elected to a full term later in 1814, Roberts was the chairman of the Committee on Claims from the 14th through to the 16th Congress inclusive.[2] During the 16th he was also on the Committee to Audit and Control the Contingent Expenses and the Committee on Public Buildings.[2] He left the Senate on March 4, 1821.[2]
From 1823 to 1826 he was again a member of the Pennsylvania House of Representatives, and later became the collector of customs at the port of Philadelphia from 1841 to 1842.[2] In 1848, Roberts built a school in Upper Merion for poor children who had to walk some distance from mill workers' houses to their previous school.[1]
He died at the age of 82 on his farm, Robertsville, in King of Prussia, and was interred in the Roberts family cemetery In Upper Merion township, near Norristown, Montgomery County, Pennsylvania.[2]