As a freshman in 2022, Veltkamp appeared in just one game where he completed all four of his pass attempts for 25 yards.[2] In the 2023 Famous Toastery Bowl, he came in for relief where he threw for 383 yards and five touchdowns, as he helped the Hilltoppers to a comeback overtime win over Old Dominion.[3] Veltkamp finished the 2023 season completing 41 of his 54 passes for 387 yards and five touchdowns to one interception, while also adding 76 yards on the ground.[2] In week 3 of the 2024 season, he came in for relief for injured starter T. J. Finley and completed 27 of 30 pass attempts for 398 yards and five touchdowns, while also adding a touchdown on the ground, as he helped Western Kentucky to a win over Middle Tennessee State.[4] For his performance against Middle Tennessee State, Veltkamp was named the Conference USA offensive player of the week, while also being named to the Davey O’Brien Award’s Great 8 list and a Manning Award Star of the Week.[5] Heading into week 4, he was named the team's starting quarterback, set to make his first career start.[6][7] In Veltkamp's first career start, he completed 20 of his 30 passing attempts for 242 yards and a touchdown, while also adding two touchdowns on the ground, as he helped the Hilltoppers to a comeback win over Toledo.[8]
On December 10, 2024, Veltkamp announced that he would enter the transfer portal.[9]