Japan's prime minister and the International Olympic Committee agreed to reschedule the 2020 Summer Olympics to summer of 2021.