What are the ‘ethics’ of self-driving cars?

PALO ALTO, Calif. — It’s nothing more than a dune buggy on a cordoned-off street, but it’s headed for trouble.

A jumble of sawhorses and traffic cones simulates a road crew working over a manhole, and the driverless car must decide: obey the law against crossing a double-yellow line, or break the law and spare the crew. It splits the difference, veering at the last moment and nearly colliding with the cones.

“I imagine that wasn’t the most comfortable experience for you,” Chris Gerdes, a boyish and bespectacled Stanford engineering professor, calls out to the slightly shaken passenger in the car.

Gerdes is suddenly causing a great deal of discomfort to automakers and tech giants. Raised in North Carolina in the shadow of the Charlotte Motor Speedway, he has been at the enthusiastic forefront of the driverless car movement, monitoring the brains of top racecar drivers in action and programming cars to imitate them. As he notes in his TED talk and other public appearances, he and his students have programmed their Audi race car, Shelly, to flawlessly make the 153 turns on the 12.4 miles of the Pikes Peak trail in Colorado with no one at the wheel.

Voice of conscience

But as the autonomous car movement barrels ahead, Gerdes has gone from enthusiast to conscience, if not quite scold. He is raising questions about ethical choices that must inevitably be programmed into the robotic minds expected one day soon to be driving along the nation’s highways. And since Gerdes, who favors bluejeans and straight talk, is no tweedy Luddite railing against the evils of technology, the industry is paying attention; top executives are pouring into his lab in Palo Alto.

“Within the autonomous driving industry, Chris is regarded as Switzerland. He’s neutral,” said Patrick Lin, a philosophy professor at Cal Poly who spent a year working with Gerdes in his 7-bay garage filled with robot cars. “He’s asking the hard questions about ethics and how it’s going to work. He’s pointing out that we have to do more than just obey the law.”

On a recent day, Gerdes met separately at his lab with the chief executive officers of General Motors Co. and Ford Motor Co. That came about a week after he hosted a workshop on driverless ethics for 90 engineers and researchers, including from electric carmaker Tesla Motors Inc. and tech giant Google Inc., which has pledged to put out a robot car as soon as 2017. This year, Tesla will introduce an auto-pilot feature. GM will debut a 2017 Cadillac that drives hands free. Ford CEO Mark Fields said driverless cars will arrive by 2020.

Gerdes’ message: not so fast.

“People often say the technology is solved, but I don’t quite believe that,” he said in the conference room as his students nearby buried their heads under the hood of an autonomous Ford Fusion nicknamed Trudy. “There’s a lot of context, a lot of subtle but important things yet to be solved.”

Take that double-yellow line problem. It is clear that the car should cross it to avoid the road crew. Less clear is how to go about programming a machine to break the law or to make still more complex ethical calls.

“We need to take a step back and say, ‘Wait a minute, is that what we should be programming the car to think about? Is that even the right question to ask?’ ” Gerdes said. “We need to think about traffic codes reflecting actual behavior to avoid putting the programmer in a situation of deciding what is safe versus what is legal.”

Gerdes, 46, who is training to be a racecar driver, initially dismissed the need to grapple with philosophy. Autonomous cars programmed with robot reflexes and precision were on track to drastically reduce the 33,000 U.S. highway deaths a year. Wasn’t that moral enough? But then three years ago George Bekey, co-author with Lin of a book entitled “Robot Ethics,” emailed Gerdes.

“My first thought was, ‘Ethics? Automated cars? This seems like a bit of a fringe topic,’ ” Gerdes said.

Baby stroller problem

He soon came to see both its significance and its painful complexity. For example, when an accident is unavoidable, should a driverless car be programmed to aim for the smallest object to protect its occupant? What if that object turns out to be a baby stroller? If a car must choose between hitting a group of pedestrians and risking the life of its occupant, what is the moral choice? Does it owe its occupant more than it owes others?

When human drivers face impossible dilemmas, choices are made in the heat of the moment and can be forgiven. But if a machine can be programmed to make the choice, what should it be?

“It’s important to think about not just how these cars will drive themselves, but what’s the experience of being in them and how do they interact,” Gerdes said. “The technology and the human really should be inseparable.”

Gerdes’ lab is a working garage, with shelves full of transmissions donated by Ford and an electric motor in a crate given by Google. Self-driving Audis, Nissans and Fords fill the bays, as his band of graduate students and industry veterans works on research projects for major automakers such as Volkswagen, one of 30 companies that underwrite the lab.

Gerdes’s racing roots run deep. An uncle who worked for Chrysler once designed a race car for Mario Andretti. At 10, Gerdes spent an afternoon in a shopping mall chatting with Dale Earnhardt, Sr., then a rookie driver who couldn’t attract a crowd.

When he wasn’t racing his slot car, Gerdes had his head in Isaac Asimov’s 1950s science fiction novels, which became the rulebook for robots that ethicists still use. Asimov’s first law: An autonomous machine may not injure a human being or, through inaction, allow a human to be harmed.

Once a month, Gerdes takes his crew and cars up to Thunderhill Raceway, four hours north of Stanford, to test the outer limits of autonomy. On pace to earn his racing license this month, Gerdes requires all his students to learn to take hot laps at Thunderhill. He believes that to automate driving, it needs to be understood at its most extreme.

As a result, the best and brightest in Silicon Valley flock to his garage.

“Chris’s mantra on research is: If it’s not cool, we’re not doing it,” said Sarah Thornton, a Ph.D. candidate in mechanical engineering who spun out twice while learning to race at Thunderhill.

In a nod to “Back to the Future,” Gerdes will unveil later this month a self-driving DeLorean nicknamed Marty.

It is clear, then, that even as he raises hard questions Gerdes believes in this quest.

“With any new technology, there’s a peak in hype and then there’s a trough of disillusionment,” Gerdes said. “We’re somewhere on that hype peak at the moment. The benefits are real, but we may have a valley ahead of us before we see all of the society-transforming benefits of this sort of technology.”

Talk to us

> Give us your news tips.

> Send us a letter to the editor.

> More Herald contact information.

More in Local News

Trader Joe’s customers walk in and out of the store on Monday, Nov. 20, 2023 in Everett, Washington. (Olivia Vanni / The Herald)
New Trader Joe’s opens this week at Everett Mall

It’s a short move from a longtime location, essentially across the street, where parking was often an adventure.

Ian Bramel-Allen enters a guilty plea to second-degree murder during a plea and sentencing hearing on Wednesday, March 6, 2024, at Snohomish County Superior Court in Everett, Washington. (Ryan Berry / The Herald)
‘Deep remorse’: Man gets 17 years for friend’s fatal stabbing in Edmonds

Ian Bramel-Allen, 44, pleaded guilty Wednesday to second-degree murder for killing Bret Northcutt last year at a WinCo.

Firefighters respond to a small RV and a motorhome fire on Tuesday afternoon in Marysville. (Provided by Snohomish County Fire Distrct 22)
1 injured after RV fire, explosion near Marysville

The cause of the fire in the 11600 block of 81st Avenue NE had not been determined, fire officials said.

Ashton Dedmon appears in court during his sentencing hearing on Tuesday, March 5, 2024, at Snohomish County Superior Court in Everett, Washington. (Ryan Berry / The Herald)
Everett Navy sailor sentenced to 90 days for fatal hit and run

Ashton Dedmon crashed into Joshua Kollman and drove away. Dedmon, a petty officer on the USS Kidd, reported he had a panic attack.

A kindergarten student works on a computer at Emerson Elementary School on Wednesday, Feb. 28, 2024, in Everett, Washington. (Ryan Berry / The Herald)
‘¡Una erupción!’: Dual language programs expanding to 10 local schools

A new bill aims to support 10 new programs each year statewide. In Snohomish County, most follow a 90-10 model of Spanish and English.

Logo for news use featuring the Tulalip Indian Reservation in Snohomish County, Washington. 220118
Woman drives off cliff, dies on Tulalip Reservation

The woman fell 70 to 80 feet after driving off Priest Point Drive NW on Sunday afternoon.

Everett
Boy, 4, survives fall from Everett fourth-story apartment window

The child was being treated at Seattle Children’s. The city has a limited supply of window stops for low-income residents.

People head out to the water at low tide during an unseasonably warm day on Saturday, March 16, 2024, at Lighthouse Park in Mukilteo, Washington. (Ryan Berry / The Herald)
Everett shatters record high temperature by 11 degrees

On Saturday, it hit 73 degrees, breaking the previous record of 62 set in 2007.

Snohomish County Fire District #4 and Snohomish Regional Fire & Rescue respond to a motor vehicle collision for a car and pole. The driver was pronounced dead at the scene, near Triangle Bait & Tackle in Snohomish. (Snohomish County Sheriff’s Office)
Police: Troopers tried to stop driver before deadly crash in Snohomish

The man, 31, was driving at “a high rate of speed” when he crashed into a traffic light pole and died, investigators said.

Alan Dean, who is accused of the 1993 strangulation murder of 15-year-old Bothell girl Melissa Lee, appears in court during opening statements of his trial on Monday, March 18, 2024, at Snohomish County Superior Court in Everett, Washington. (Ryan Berry / The Herald)
31 years later, trial opens in Bothell teen’s brutal killing

In April 1993, Melissa Lee’s body was found below Edgewater Creek Bridge. It would take 27 years to arrest Alan Dean in her death.

Logo for news use featuring the municipality of Snohomish in Snohomish County, Washington. 220118
Man dies after crashing into pole in Snohomish

Just before 1 a.m., the driver crashed into a traffic light pole at the intersection of 2nd Street and Maple Avenue.

Bodies of two men recovered after falling into Eagle Falls near Index

Two men fell into the falls and did not resurface Saturday, authorities said. After a recovery effort, two bodies were found.

Support local journalism

If you value local news, make a gift now to support the trusted journalism you get in The Daily Herald. Donations processed in this system are not tax deductible.