The former president instead participated in a town hall just minutes down the street from the debate.