The director of Exempt Organizations said she did not break any IRS rules, and then invoked the Fifth.