Vision trumps hearing in study

DURHAM, N.C. — A Duke University study used puppet-based comedy to demonstrate the complicated inner-workings of the brain and shows what every ventriloquist knows: The eye is more convincing than the ear.

The study, which appears in the journal PLOS ONE, seeks to explain how the brain combines information coming from two different senses. How, asks Duke psychology and neuroscience professor Jennifer Groh, does the brain determine where a sound is coming from?

In your eyes, the retina takes a snapshot, she said. It makes a topographic image of what’s in front of you. But the ears have nothing concrete to go on. They have to rely on how loud the sound is, how far away and from what direction.

ADVERTISEMENT
0 seconds of 0 secondsVolume 0%
Press shift question mark to access a list of keyboard shortcuts
00:00
00:00
00:00
 

That’s where a ventriloquist comes in, providing a model for this problem. With a puppet, the noise and the movement are coming from different places. So how does the brain fix this and choose where to look?

Duke researchers tested their hypotheses on 11 people and two monkeys, placing them in a soundproof booth.

They arranged speakers in various locations and attached lights to them.

Then they played a sound from one speaker and flashed a light from another, tracking people’s eye movements. Sometimes they played the sound in time with the light, but only for just a fraction of a second. Sometimes they played the sound first, then followed up with the light.

Results: People moved their eyes much more when the light came at a different time with the sound. To sum up, it doesn’t matter if sounds and lights happen at the same time, in the same place. It’s more important that the eyes get a clue to give back to the brain.

“Vision is so much better at informing location,” Groh said. “Why do we have the ventriloquist illusion? That illusion occurs because of the power of vision to correct errors.”

This rings true to Cynthia Foust, a real ventriloquist in Rocky Mount.

She spent about six months practicing on her own before taking her show to day cares, where she aims to keep children’s eyes on the puppet’s mouth.

“You kind of keep things animated with the puppet so they’re not looking at me,” Foust said.

Talk to us

> Give us your news tips.

> Send us a letter to the editor.

> More Herald contact information.

More in Local News

Cars drive along Cathcart Way next to the site of the proposed Eastview Village development that borders Little Cedars Elementary on Wednesday, May 7, 2025 in unincorporated Snohomish, Washington. (Olivia Vanni / The Herald)
Former engineer: Snohomish County rushed plans for Eastview development

David Irwin cited red flags from the developers. After he resigned, the county approved the development that’s now stalled with an appeal

Outside of the Madrona School on Monday, Aug. 26, 2024 in Edmonds, Washington. (Olivia Vanni / The Herald)
Sewer district notifies Edmonds schools of intent to sue

The letter of intent alleges the school district has failed to address long-standing “water pollution issues” at Madrona K-8 School.

Everett
Man stabbed in face outside Everett IHOP, may lose eye

Police say the suspect fled in the victim’s car, leading officers on a 6-mile chase before his arrest.

A person walks up 20th Street Southeast to look at the damage that closed the road on Wednesday, Nov. 20, 2024 in Lake Stevens, Washington. (Olivia Vanni / The Herald)
WA delegation urges Trump to reconsider request for bomb cyclone aid

The Washington state congressional delegation urged President Donald Trump on… Continue reading

Aaron Weinstock uses an x-ray machine toy inside the Imagine Children Museum on Tuesday, Dec. 3, 2024 in Everett, Washington. (Olivia Vanni / The Herald)
Imagine Children’s Museum $250k grant reinstated following federal court order

The federal grant supports a program that brings free science lessons to children throughout rural Snohomish County.

Snohomish County 911 Executive Director Kurt Mills talks about the improvements made in the new call center space during a tour of the building on Tuesday, May 20, 2025 in Everett, Washington. (Olivia Vanni / The Herald)
New 911 center in Everett built to survive disaster

The $67.5 million facility brings all emergency staff under one roof with seismic upgrades, wellness features and space to expand.

Everett
Five arrested in connection with Everett toddler’s 2024 overdose death

More than a year after 13-month-old died, Everett police make arrests in overdose case.

Madison Family Shelter Family Support Specialist Dan Blizard talks about one of the pallet homes on Monday, May 19, 2025 in Everett, Washington. (Olivia Vanni / The Herald)
Madison Family Shelter reopens after hiatus

The Pallet shelter village, formerly Faith Family Village, provides housing for up to eight families for 90 days.

Help Washington manage European green crabs with citizen science events

Washington State University and Washington Sea Grant will hold a training at Willis Tucker Park on June 2.

Emilee Swenson pulls kids around in a wagon at HopeWorks' child care center Tomorrow’s Hope, a job training program for people interested in child care, on Tuesday, Sept. 7, 2021 in Everett, Washington. HopeWorks is one of the organizations reciving funding from the ARPA $4.3 million stipend. (Andy Bronson / The Herald)
Early learning group presents countywide survey findings

The survey highlighted the largest issues parents and providers are facing amid the county’s child care crisis.

Brian Murril, who started at Liberty Elementary as a kindergartner in 1963, looks for his yearbook photograph during an open house for the public to walk through the school before its closing on Thursday, May 29, 2025 in Marysville, Washington. (Olivia Vanni / The Herald)
Locals say goodbye to Marysville school after 74 years

Liberty Elementary is one of two schools the Marysville School District is closing later this year to save costs.

U.S. Sen. Patty Murray speaks at a round table discussion with multiple Snohomish County agencies about the Trump administrator restricting homelessness assistance funding on Thursday, May 29, 2025 in Everett, Washington. (Olivia Vanni / The Herald)
Sen. Murray hears from county homelessness assistance providers

In early May, Snohomish County sued the Trump administration for putting unlawful conditions on $16.7M in grant funding.

Support local journalism

If you value local news, make a gift now to support the trusted journalism you get in The Daily Herald. Donations processed in this system are not tax deductible.