Two women who said the celebrity chef attacked them were unable to recall critical information, sources said.