What are the ‘ethics’ of self-driving cars?

PALO ALTO, Calif. — It’s nothing more than a dune buggy on a cordoned-off street, but it’s headed for trouble.

A jumble of sawhorses and traffic cones simulates a road crew working over a manhole, and the driverless car must decide: obey the law against crossing a double-yellow line, or break the law and spare the crew. It splits the difference, veering at the last moment and nearly colliding with the cones.

“I imagine that wasn’t the most comfortable experience for you,” Chris Gerdes, a boyish and bespectacled Stanford engineering professor, calls out to the slightly shaken passenger in the car.

Gerdes is suddenly causing a great deal of discomfort to automakers and tech giants. Raised in North Carolina in the shadow of the Charlotte Motor Speedway, he has been at the enthusiastic forefront of the driverless car movement, monitoring the brains of top racecar drivers in action and programming cars to imitate them. As he notes in his TED talk and other public appearances, he and his students have programmed their Audi race car, Shelly, to flawlessly make the 153 turns on the 12.4 miles of the Pikes Peak trail in Colorado with no one at the wheel.

Voice of conscience

But as the autonomous car movement barrels ahead, Gerdes has gone from enthusiast to conscience, if not quite scold. He is raising questions about ethical choices that must inevitably be programmed into the robotic minds expected one day soon to be driving along the nation’s highways. And since Gerdes, who favors bluejeans and straight talk, is no tweedy Luddite railing against the evils of technology, the industry is paying attention; top executives are pouring into his lab in Palo Alto.

“Within the autonomous driving industry, Chris is regarded as Switzerland. He’s neutral,” said Patrick Lin, a philosophy professor at Cal Poly who spent a year working with Gerdes in his 7-bay garage filled with robot cars. “He’s asking the hard questions about ethics and how it’s going to work. He’s pointing out that we have to do more than just obey the law.”

On a recent day, Gerdes met separately at his lab with the chief executive officers of General Motors Co. and Ford Motor Co. That came about a week after he hosted a workshop on driverless ethics for 90 engineers and researchers, including from electric carmaker Tesla Motors Inc. and tech giant Google Inc., which has pledged to put out a robot car as soon as 2017. This year, Tesla will introduce an auto-pilot feature. GM will debut a 2017 Cadillac that drives hands free. Ford CEO Mark Fields said driverless cars will arrive by 2020.

Gerdes’ message: not so fast.

“People often say the technology is solved, but I don’t quite believe that,” he said in the conference room as his students nearby buried their heads under the hood of an autonomous Ford Fusion nicknamed Trudy. “There’s a lot of context, a lot of subtle but important things yet to be solved.”

Take that double-yellow line problem. It is clear that the car should cross it to avoid the road crew. Less clear is how to go about programming a machine to break the law or to make still more complex ethical calls.

“We need to take a step back and say, ‘Wait a minute, is that what we should be programming the car to think about? Is that even the right question to ask?’ ” Gerdes said. “We need to think about traffic codes reflecting actual behavior to avoid putting the programmer in a situation of deciding what is safe versus what is legal.”

Gerdes, 46, who is training to be a racecar driver, initially dismissed the need to grapple with philosophy. Autonomous cars programmed with robot reflexes and precision were on track to drastically reduce the 33,000 U.S. highway deaths a year. Wasn’t that moral enough? But then three years ago George Bekey, co-author with Lin of a book entitled “Robot Ethics,” emailed Gerdes.

“My first thought was, ‘Ethics? Automated cars? This seems like a bit of a fringe topic,’ ” Gerdes said.

Baby stroller problem

He soon came to see both its significance and its painful complexity. For example, when an accident is unavoidable, should a driverless car be programmed to aim for the smallest object to protect its occupant? What if that object turns out to be a baby stroller? If a car must choose between hitting a group of pedestrians and risking the life of its occupant, what is the moral choice? Does it owe its occupant more than it owes others?

When human drivers face impossible dilemmas, choices are made in the heat of the moment and can be forgiven. But if a machine can be programmed to make the choice, what should it be?

“It’s important to think about not just how these cars will drive themselves, but what’s the experience of being in them and how do they interact,” Gerdes said. “The technology and the human really should be inseparable.”

Gerdes’ lab is a working garage, with shelves full of transmissions donated by Ford and an electric motor in a crate given by Google. Self-driving Audis, Nissans and Fords fill the bays, as his band of graduate students and industry veterans works on research projects for major automakers such as Volkswagen, one of 30 companies that underwrite the lab.

Gerdes’s racing roots run deep. An uncle who worked for Chrysler once designed a race car for Mario Andretti. At 10, Gerdes spent an afternoon in a shopping mall chatting with Dale Earnhardt, Sr., then a rookie driver who couldn’t attract a crowd.

When he wasn’t racing his slot car, Gerdes had his head in Isaac Asimov’s 1950s science fiction novels, which became the rulebook for robots that ethicists still use. Asimov’s first law: An autonomous machine may not injure a human being or, through inaction, allow a human to be harmed.

Once a month, Gerdes takes his crew and cars up to Thunderhill Raceway, four hours north of Stanford, to test the outer limits of autonomy. On pace to earn his racing license this month, Gerdes requires all his students to learn to take hot laps at Thunderhill. He believes that to automate driving, it needs to be understood at its most extreme.

As a result, the best and brightest in Silicon Valley flock to his garage.

“Chris’s mantra on research is: If it’s not cool, we’re not doing it,” said Sarah Thornton, a Ph.D. candidate in mechanical engineering who spun out twice while learning to race at Thunderhill.

In a nod to “Back to the Future,” Gerdes will unveil later this month a self-driving DeLorean nicknamed Marty.

It is clear, then, that even as he raises hard questions Gerdes believes in this quest.

“With any new technology, there’s a peak in hype and then there’s a trough of disillusionment,” Gerdes said. “We’re somewhere on that hype peak at the moment. The benefits are real, but we may have a valley ahead of us before we see all of the society-transforming benefits of this sort of technology.”

Talk to us

> Give us your news tips.

> Send us a letter to the editor.

> More Herald contact information.

More in Local News

A firefighter stands in silence before a panel bearing the names of L. John Regelbrugge and Kris Regelbrugge during the ten-year remembrance of the Oso landslide on Friday, March 22, 2024, at the Oso Landslide Memorial in Oso, Washington. (Ryan Berry / The Herald)
‘Flood of emotions’ as Oso Landslide Memorial opens on 10th anniversary

Friends, family and first responders held a moment of silence at 10:37 a.m. at the new 2-acre memorial off Highway 530.

Julie Petersen poses for a photo with images of her sister Christina Jefferds and Jefferds’ grand daughter Sanoah Violet Huestis next to a memorial for Sanoah at her home on March 20, 2024 in Arlington, Washington. Peterson wears her sister’s favorite color and one of her bangles. (Annie Barker / The Herald)
‘It just all came down’: An oral history of the Oso mudslide

Ten years later, The Daily Herald spoke with dozens of people — first responders, family, survivors — touched by the deadliest slide in U.S. history.

Victims of the Oso mudslide on March 22, 2014. (Courtesy photos)
Remembering the 43 lives lost in the Oso mudslide

The slide wiped out a neighborhood along Highway 530 in 2014. “Even though you feel like you’re alone in your grief, you’re really not.”

Director Lucia Schmit, right, and Deputy Director Dara Salmon inside the Snohomish County Department of Emergency Management on Friday, March 8, 2024, in Everett, Washington. (Ryan Berry / The Herald)
How Oso slide changed local emergency response ‘on virtually every level’

“In a decade, we have just really, really advanced,” through hard-earned lessons applied to the pandemic, floods and opioids.

Ron and Gail Thompson at their home on Monday, March 4, 2024 in Oso, Washington. (Olivia Vanni / The Herald)
In shadow of scarred Oso hillside, mudslide’s wounds still feel fresh

Locals reflected on living with grief and finding meaning in the wake of a catastrophe “nothing like you can ever imagine” in 2014.

The view of Mountain Loop Mine out the window of a second floor classroom at Fairmount Elementary on Wednesday, Jan. 10, 2024 in Everett, Washington. (Olivia Vanni / The Herald)
County: Everett mining yard violated order halting work next to school

At least 10 reports accused OMA Construction of violating a stop-work order next to Fairmount Elementary. A judge will hear the case.

Imagine Children's Museum's incoming CEO, Elizabeth "Elee" Wood. (Photo provided by Imagine Children's Museum)
Imagine Children’s Museum in Everett will welcome new CEO in June

Nancy Johnson, who has led Imagine Children’s Museum in Everett for 25 years, will retire in June.

Kelli Littlejohn, who was 11 when her older sister Melissa Lee was murdered, speaks to a group of investigators and deputies to thank them for bringing closure to her family after over 30 years on Thursday, March 28, 2024, at Snohomish County Superior Court in Everett, Washington. (Ryan Berry / The Herald)
‘She can rest in peace’: Jury convicts Bothell man in 1993 killing

Even after police arrested Alan Dean in 2020, it was unclear if he would stand trial. He was convicted Thursday in the murder of Melissa Lee, 15.

Ariel Garcia, 4, was last seen Wednesday morning in an apartment in the 4800 block of Vesper Dr. (Photo provided by Everett Police)
Everett police searching for missing child, 4

Ariel Garcia was last seen Wednesday at an apartment in the 4800 block of Vesper Drive. The child was missing under “suspicious circumstances.”

The rezoned property, seen here from the Hillside Vista luxury development, is surrounded on two sides by modern neighborhoods Monday, March 25, 2024, in Lake Stevens, Washington. (Ryan Berry / The Herald)
Despite petition, Lake Stevens OKs rezone for new 96-home development

The change faced resistance from some residents, who worried about the effects of more density in the neighborhood.

Rep. Suzan DelBene, left, introduces Xichitl Torres Small, center, Undersecretary for Rural Development with the U.S. Department of Agriculture during a talk at Thomas Family Farms on Monday, April 3, 2023, in Snohomish, Washington. (Olivia Vanni / The Herald)
Under new federal program, Washingtonians can file taxes for free

At a press conference Wednesday, U.S. Rep. Suzan DelBene called the Direct File program safe, easy and secure.

Former Snohomish County sheriff’s deputy Jeremie Zeller appears in court for sentencing on multiple counts of misdemeanor theft Wednesday, March 27, 2024, at Snohomish County Superior Court in Everett, Washington. (Ryan Berry / The Herald)
Ex-sheriff’s deputy sentenced to 1 week of jail time for hardware theft

Jeremie Zeller, 47, stole merchandise from Home Depot in south Everett, where he worked overtime as a security guard.

Support local journalism

If you value local news, make a gift now to support the trusted journalism you get in The Daily Herald. Donations processed in this system are not tax deductible.