The weather could impact holiday travelers as 31.6 million people are expected to take to the skies this holiday weekend.