Comment: Ignorance, complacency on AI already posing threats

Artificial intelligence is pervasive, often in ways we are unaware, and not always to our benefit.

By Anjana Susarla / The Conversation

The turmoil at ChatGPT-maker OpenAI, bookended by the board of directors firing high-profile CEO Sam Altman on Nov. 17, then rehiring him just four days later, has put a spotlight on artificial intelligence safety and concerns about the rapid development of artificial general intelligence, or AGI. AGI is loosely defined as human-level intelligence across a range of tasks.

The OpenAI board stated that Altman’s termination was for lack of candor, but speculation has centered on a rift between Altman and members of the board over concerns that OpenAI’s remarkable growth — products such as ChatGPT and Dall-E have acquired hundreds of millions of users worldwide — has hindered the company’s ability to focus on catastrophic risks posed by AGI.

OpenAI’s goal of developing AGI has become entwined with the idea of AI acquiring superintelligent capabilities and the need to safeguard against the technology being misused or going rogue. But for now, AGI and its attendant risks are speculative. Task-specific forms of AI, meanwhile, are very real, have become widespread and often fly under the radar.

As a researcher of information systems and responsible AI, I study how these everyday algorithms work; and how they can harm people.

AI is pervasive: AI plays a visible part in many people’s daily lives, from face recognition unlocking your phone to speech recognition powering your digital assistant. It also plays roles you might be vaguely aware of; for example, shaping your social media and online shopping sessions, guiding your video-watching choices and matching you with a driver in a ride-sharing service.

AI also affects your life in ways that might completely escape your notice. If you’re applying for a job, many employers use AI in the hiring process. Your bosses might be using it to identify employees who are likely to quit. If you’re applying for a loan, odds are your bank is using AI to decide whether to grant it. If you’re being treated for a medical condition, your health care providers might use it to assess your medical images. And if you know someone caught up in the criminal justice system, AI could well play a role in determining the course of their life.

Algorithmic harms: Many of the AI systems that fly under the radar have biases that can cause harm. For example, machine learning methods use inductive logic, which starts with a set of premises, to generalize patterns from training data. A machine learning-based resume screening tool was found to be biased against women because the training data reflected past practices when most resumes were submitted by men.

The use of predictive methods in areas ranging from health care to child welfare could exhibit biases such as cohort bias that lead to unequal risk assessments across different groups in society. Even when legal practices prohibit discrimination based on attributes such as race and gender — for example, in consumer lending — proxy discrimination can still occur. This happens when algorithmic decision-making models do not use characteristics that are legally protected, such as race, and instead use characteristics that are highly correlated or connected with the legally protected characteristic, like neighborhood. Studies have found that risk-equivalent Black and Latino borrowers pay significantly higher interest rates on government-sponsored enterprise securitized and Federal Housing Authority-insured loans than white borrowers.

Another form of bias occurs when decision-makers use an algorithm differently from how the algorithm’s designers intended. In a well-known example, a neural network learned to associate asthma with a lower risk of death from pneumonia. This was because asthmatics with pneumonia are traditionally given more aggressive treatment that lowers their mortality risk compared to the overall population. However, if the outcome from such a neural network is used in hospital bed allocation, then those with asthma and admitted with pneumonia would be dangerously deprioritized.

Biases from algorithms can also result from complex societal feedback loops. For example, when predicting recidivism, authorities attempt to predict which people convicted of crimes are likely to commit crimes again. But the data used to train predictive algorithms is actually about who is likely to get re-arrested.

AI safety in the here and now: The Biden administration’s recent executive order and enforcement efforts by federal agencies such as the Federal Trade Commission are the first steps in recognizing and safeguarding against algorithmic harms.

And though large language models, such as GPT-3 that powers ChatGPT, and multimodal large language models, such as GPT-4, are steps on the road toward artificial general intelligence, they are also algorithms people are increasingly using in school, work and daily life. It’s important to consider the biases that result from widespread use of large language models.

For example, these models could exhibit biases resulting from negative stereotyping involving gender, race or religion, as well as biases in representation of minorities and disabled people. As these models demonstrate the ability to outperform humans on tests such as the bar exam, I believe that they require greater scrutiny to ensure that AI-augmented work conforms to standards of transparency, accuracy and source crediting, and that stakeholders have the authority to enforce such standards.

Ultimately, who wins and loses from large-scale deployment of AI may not be about rogue superintelligence, but about understanding who is vulnerable when algorithmic decision-making is ubiquitous.

Anjana Susarla is a professor of accounting and information systems at Michigan State University. This article is republished from The Conversation under a Creative Commons license.

Talk to us

> Give us your news tips.

> Send us a letter to the editor.

> More Herald contact information.

More in Opinion

toon
Editorial cartoons for Saturday, Feb. 24

A sketchy look at the news of the day.… Continue reading

FILE - In this Aug. 21, 2015 file photo, a tanker airplane drops fire retardant on a wildfire burning near Twisp, Wash. Three firefighters were killed battling the blaze. The story was a top Washington state news item in 2015. Public Lands Commissioner Hilary Franz has proposed a plan to strengthen the ways that Washington can prevent and respond to wildfires. Franz released the 10-year plan last week as part of her $55 million budget request to the Legislature to improve the state's firefighting abilities (AP Photo/Ted S. Warren, File)
Editorial: Wildfire threat calls for restoring full funding

Lawmakers should restore funding for fighting wildfires and call on one furry firefighter in particular.

Comment: Charity scandal shows Providence ignoring its mission

Ordered to forgive $157 million it charged the poor, the hospital system needs better oversight of officials.

Comment: Wildfire problem is matter of fuel load, not climate

By limiting the harvest of timber in the state we allowed the forests’ fuel load to grow; and then burn.

Comment: Street seating in Snohomish needs to get permit or go

With the pandemic emergency over, the city can’t allow street seating to remain unless permitted.

Forum: Keeping gazebo great idea, but who’s going to pay for it?

The Bayside Neighborhood has discussed this for three years, but the city doesn’t have the $300,000 to restore it.

Ron Friesen
Forum: It’s great to hear when we’re right, but don’t stop there

Being right about taxes, politics, schools and more is so satisfying, but why isn’t enough to fix it all?

toon
Editorial cartoons for Friday, Feb. 23

A sketchy look at the news of the day.… Continue reading

Jaime Benedict, who works as a substitute teacher, waves to drivers on the corner of Mukilteo Speedway and Harbor Pointe Boulevard while holding a sign in support of the $240 million capital bond proposal for Mukilteo School District on Tuesday, Feb. 11, 2020 in Mukilteo, Wash. (Olivia Vanni / The Herald)
Editorial: Bar set unfairly high for passage of school bonds

Requiring 60 percent approval denies too many students the schools and facilities they deserve.

Comment: Presidential primary launches state’s election season

With ballots in the mail, here’s what to know and how to prepare for making your choice for U.S. president.

Schwab: Moscow’s a paradise, Trump is Navalny, and up is down

If it’s difficult for some in the GOP to keep up with shifts in allegiances, Trump and Tucker are here for it.

School bond supermajority requirement is unacceptable

I’m looking at the Spokesman-Review online like I do every day, and… Continue reading

Support local journalism

If you value local news, make a gift now to support the trusted journalism you get in The Daily Herald. Donations processed in this system are not tax deductible.