Holder said he had removed himself from the matter because of congressional testimony he had given and his dealings with the news media.
The Justice Department secretly obtained two months of telephone records of AP reporters and editors.
Holder said federal prosecutors are looking into the matter.
"This was a very serious leak, a very grave leak" that "put the American people at risk," Holder told reporters at a news conference Tuesday.
Holder has assigned Deputy Attorney General Jim Cole to handle the phone records case.
The Justice Department secretly obtained two months of telephone records of reporters and editors for The AP in what the news cooperative's top executive called a massive and unprecedented intrusion into how news organizations gather the news.
More Nation & World Headlines
Al-Qaida captures leader of U.S.-backed Syrian rebels California cuts water use by 27 percent George McGovern revealed he had a secret child Pentagon OKs guns to protect stateside troops Man describes finding 777 part on Reunion Island Blue moon? Celestial event comes with a catch U.S. looking for lion-killing Minnesota dentist 3 hurt in emergency evacuation of Boeing MD-80
Our new comment system is not supported in IE 7. Please upgrade your browser here.