The superstar will debut her new music video, "Out of the Woods," during the New Year's Eve celebration with Ryan Seacrest on ABC.