The former FBI director said his wife, Patrice, gave him the warning when he was deputy attorney general for George W. Bush.