The president said "it's been a very, very tough time" for his former presidential campaign chairman.