The Biden administration has canceled nearly $5 billion in student debt for thousands of borrowers across the country.