Microsoft takes bot ‘Tay’ offline after offensive remarks

  • Bloomberg.
  • Thursday, March 24, 2016 1:32pm
  • Business

Microsoft is in damage control mode after Twitter users exploited its new artificial intelligence chat bot, teaching it to spew racist, sexist and offensive remarks.

The company introduced earlier this week to chat with real humans on Twitter and other messaging platforms. The bot learns by parroting comments and then generating its own answers and statements based on all of its interactions. It was supposed to emulate the casual speech of a stereotypical millennial. The Internet took advantage and quickly tried to see how far it could push Tay.

The worst tweets are quickly disappearing from Twitter, and Tay itself has now also gone offline “to absorb it all.” Some Twitter users appear to think that Microsoft had also manually banned people from interacting with the bot. Others are asking why the company didn’t build filters to prevent Tay from discussing certain topics, such as the Holocaust.

ADVERTISEMENT
0 seconds of 0 secondsVolume 0%
Press shift question mark to access a list of keyboard shortcuts
00:00
00:00
00:00
 

“The AI chatbot Tay is a machine learning project, designed for human engagement,” Microsoft said in a statement. “It is as much a social and cultural experiment, as it is technical. Unfortunately, within the first 24 hours of coming online, we became aware of a coordinated effort by some users to abuse Tay’s commenting skills to have Tay respond in inappropriate ways. As a result, we have taken Tay offline and are making adjustments.”

The bot was targeted at 18- to 24-year-olds in the U.S. and meant to entertain and engage people through casual and playful conversation, according to Microsoft’s website. Tay was built with public data and content from improvisational comedians. It’s supposed to improve with more interactions, so should be able to better understand context and nuances over time. The bot’s developers at Microsoft also collect the nickname, gender, favorite food, zip code and relationship status of anyone who chats with Tay.

In less than a day, Twitter’s denizens realized Tay didn’t really know what it was talking about and that it was easy to get the bot to make inappropriate comments on any taboo subject. People got Tay to deny the Holocaust, call for genocide and lynching, equate feminism to cancer and stump for Adolf Hitler.

Tay parroted another user to spread a Donald Trump message, tweeting, “WE’RE GOING TO BUILD A WALL. AND MEXICO IS GOING TO PAY FOR IT.” Under the tutelage of Twitter’s users, Tay even learned how to make threats and identify “evil” races.

Tay is an experiment by Microsoft’s Technology and Research and Bing search engine teams to learn more about conversations. These kinds of efforts are important to develop better technology around natural language processing that could eventually lead to more sophisticated bots that are easier for people to use. Currently assistant tools such as Microsoft’s Cortana and Apple’s Siri can only handle simple, straightforward requests and aren’t able to process nuanced questions or apply contextual understanding of speech patterns such as sarcasm.

Talk to us

> Give us your news tips.

> Send us a letter to the editor.

> More Herald contact information.

More in Business

Izaac Escalante-Alvarez unpacks a new milling machine at the new Boeing machinists union’s apprentice training center on Friday, June 6, 2025 in Everett, Washington. (Olivia Vanni / The Herald)
Boeing Machinists union training center opens in Everett

The new center aims to give workers an inside track at Boeing jobs.

Some SnoCo stores see shortages after cyberattack on grocery supplier

Some stores, such as Whole Foods and US Foods CHEF’STORE, informed customers that some items may be temporarily unavailable.

People take photos and videos as the first Frontier Arlines flight arrives at Paine Field Airport under a water cannon salute on Monday, June 2, 2025 in Everett, Washington. (Olivia Vanni / The Herald)
Water cannons salute Frontier on its first day at Paine Field

Frontier Airlines joins Alaska Airlines in offering service Snohomish County passengers.

Amit B. Singh, president of Edmonds Community College. 201008
Edmonds College and schools continue diversity programs

Educational diversity programs are alive and well in Snohomish County.

A standard jet fuel, left, burns with extensive smoke output while a 50 percent SAF drop-in jet fuel, right, puts off less smoke during a demonstration of the difference in fuel emissions on Tuesday, March 28, 2023 in Everett, Washington. (Olivia Vanni / The Herald)
Sustainable aviation fuel center gets funding boost

A planned research and development center focused on sustainable aviation… Continue reading

Helion's 6th fusion prototype, Trenta, on display on Tuesday, July 9, 2024 in Everett, Washington. (Olivia Vanni / The Herald)
Helion celebrates smoother path to fusion energy site approval

Helion CEO applauds legislation signed by Gov. Bob Ferguson expected to streamline site selection process.

FILE — Jet fuselages at Boeing’s fabrication site in Everett, Wash., Sept. 28, 2022. Some recently manufactured Boeing and Airbus jets have components made from titanium that was sold using fake documentation verifying the material’s authenticity, according to a supplier for the plane makers. (Jovelle Tamayo/The New York Times)
Boeing adding new space in Everett despite worker reduction

Boeing is expanding the amount of space it occupies in… Continue reading

Patrick Russell, left, Jill Russell and their son Jackson Russell of Lake Stevens enjoy Dick’s burgers on their way home from Seattle on Friday, Sept. 22, 2023 in Edmonds, Washington. The family said the announcement of the Dick’s location in Everett “is amazing” and they will be stopping by whenever it opens in 2025. (Olivia Vanni / The Herald)
Dick’s Drive-In announces details for Thursday’s grand opening in Everett

Dick’s will celebrate its second Snohomish County location with four days of festivities.

Katie Wallace, left, checks people into the first flight from Paine Field to Honolulu on Friday, Nov. 17, 2023 in Everett, Washington. (Olivia Vanni / The Herald)
Executive order makes way for Paine Field expansion planning

Expansion would be a long-range project estimated to cost around $300 million.

Dick’s Drive-In announces opening date for new Everett location

The new drive-in will be the first-ever for Everett and the second in Snohomish County.

Support local journalism

If you value local news, make a gift now to support the trusted journalism you get in The Daily Herald. Donations processed in this system are not tax deductible.