Four secret service agents have been suspended for allegedly accepting thousands of dollars' worth of gifts.