Kennedy, the key swing vote on issues of abortion, gay rights, affirmative action and more, announced his retirement today.