The New York Democrat announced that she is forming a presidential exploratory committee Tuesday night during a taping of CBS' "The Late Show with Stephen Colbert."