"It's been my great honor to serve as your vice president, and I want to thank you for your service," Vice President Mike Pence said during his stop at Capitol Hill.