And he said Sunday that NBA players believe nobody in Sterling's family should be able to own the Los Angeles Clippers if he's gone.
Sterling has been banned for life for making racist comments and Commissioner Adam Silver has urged owners to force Sterling to sell the franchise. But Silver said no decisions had been made about the rest of Sterling's family.
Shelly Sterling, Sterling's estranged wife, said she intends to keep her 50 percent of the franchise.
"As players, we want what's right and we don't feel like no one in his family should be able to own the team," James said after the Miami Heat practiced for Game 4 of the Eastern Conference semifinals against Brooklyn.
But Shelly Sterling told ABC News' Barbara Walters that she doesn't believe she should be punished for what her husband said.
"I will fight that decision," she said in the interview. "To be honest with you, I'm wondering if a wife of one of the owners, and there's 30 owners, did something like that, said those racial slurs, would they oust the husband? Or would they leave the husband in?"
James was one of the first and strongest voices to speak out after a recording of Donald Sterling's remarks to V. Stiviano were posted on TMZ's website last month, saying the comments were unacceptable and that there was no place in the league for Sterling.
The league is trying to act quickly to remove him. Dick Parsons has been installed as the Clippers' interim CEO, and the owners' advisory/finance committee has held conference calls each of the last two weeks to discuss that process and timeline for a forced sale. That would require a three-fourths vote of owners.
But Donald Sterling, who bought the team in 1981 and is the NBA's longest-tenured owner, could choose to fight those attempts by the league.
"At the end of the day, this is going to be a long litigation when it comes to that," James said. "This guy who's owned the team since the '80s is not going to just give the team up in a day. So we understand it's going to be long, but we want what's right."
In his first public comments since being banned, Donald Sterling apologized Sunday for the racist comments captured on tape, saying they were a "terrible mistake."
"I'm not a racist," Sterling told CNN's Anderson Cooper in excerpts posted from an interview taped Sunday and set to air Monday. "I made a terrible mistake. I'm here to apologize."
Sterling said years of good behavior as an owner should count toward his future.
"I'm a good member who made a mistake," Sterling said. "Am I entitled to one mistake, am I after 35 years? I mean, I love my league, I love my partners. Am I entitled to one mistake? It's a terrible mistake, and I'll never do it again. ... If the owners feel I have another chance, then they'll give it to me."
More Sports Headlines
Goff throws 4 TD passes as Cal rallies to beat Cougars 34-28 4:36 p.m. Seahawks' Lynch, Mebane to be game-time decisions Monday night 5:38 p.m. Texas staggering after troubling 50-7 loss to No. 4 TCU 5:38 p.m. Tulane long snapper is first legally blind player to play in D-I game 5:36 p.m. Sounders have 2009 flavor for 2015 stretch run 5:26 p.m. Angels score 5 in 9th, beat Rangers 11-10 5:24 p.m. No. 1 Ohio State hangs on to beat Indiana 34-27 5:24 p.m. No. 13 Alabama routs No. 8 Georgia 38-10 5:24 p.m.
Our new comment system is not supported in IE 7. Please upgrade your browser here.