Comment: Can parents trust ChatGPT to help with kids’ homework?

It can help students understand assignments, but maybe don’t trust it to check your kids’ work.

By Parmy Olson / Bloomberg Opinion

Wednesday marked a day of teacher strikes across much of the United Kingdom, putting parents in the familiar pandemic-inspired role of homeschoolers-in-chief to their kids. Except this time, there’s a magical automated assistant on hand to help.

Educators have been cautiously praising ChatGPT, the ultra-sophisticated chatbot from OpenAI, saying it could revolutionize education. One head teacher in Britain says it has triggered a rethink on homework, while another in Oregon has used it to create lesson plans and study guides.

The tool’s personalized responses are what make it so tantalizing as an all-knowing digital tutor. I recently used it to dig into the topic of enzymes, when my 12-year-old had questions that I had no hope of answering. When ChatGPT offered a dense, technical explanation, I asked it for simpler terms and an analogy.

“Sure!” it replied. “Think of a lock on a door. The lock is like an enzyme and the key is like the substrate molecule.” It stretched the analogy further to describe the active site of an enzyme as the keyhole.

These were remarkable answers. We could have dug deeper into every facet of biochemistry if we’d wanted. Unlike a human tutor, ChatGPT can be interrogated for as long as you like.

This holds huge potential for personalized, independent learning … except that ChatGPT often gets things wrong, and it does a very good job of hiding that. When I tested one of my daughter’s English homework questions on the tool, it offered an eloquent list of examples, which on closer inspection included one that was wildly inaccurate. The main character had a turbulent relationship with his parents, the bot said, even though the character’s parents were dead throughout the book.

On another occasion, I used the tool to generate some linear equations for my daughter to practice. She was stumped when I asked the tool to generate the answers, which were different to the ones she had calculated. I asked ChatGPT for an explanation and it broke down its method in simple terms once again, sounding as authoritative as any real math tutor. But when I double-checked the answers on Google, it turned out ChatGPT’s answers were wrong and my tween’s were correct. Thus ended her mini-nightmare of failing math, and much of my initial enthusiasm for ChatGPT.

The New York City public school system, the largest in the U.S., has already banned its students from using ChatGPT, in part because of concerns about the “accuracy of content.” That is why recent comparisons of ChatGPT to a “calculator for writing” is a deceptive analogy, since calculators are always right and ChatGPT isn’t.

How inaccurate is it? A spokeswoman for OpenAI said the company had updated ChatGPT over the last couple of months to improve its factual accuracy, but that it had no statistics to share. The tool also warns users, when they first open it, that it sometimes makes mistakes.

Will it get more accurate? Yes, but it’s hard to say by how much. The large language model underpinning ChatGPT is made up of 175 billion parameters, which are settings that are used to make the model’s predictions, versus the 1.5 billion that its predecessor GPT-2 had. It’s become accepted wisdom in AI that the more parameters are added to a model, the more truthful it becomes, and the correlation is real for GPT. It became substantially more accurate when all those parameters were added. It’s rumored that the next iteration slated for release this year, called GPT-4, will have trillions.

The problem is, we don’t know whether a huge jump in parameters also means a huge jump in trustworthiness. That is why students should use ChatGPT with caution, if at all, for the foreseeable future.

When I asked Julien Cornebise, an honorary professor of computer science at University College London, if he would ever trust it as a homework tool, he replied, “Absolutely not, not yet.” He pointed out that even when the system improves, we still won’t have guarantees that it is truthful.

Students should get used to corroborating any facts the system shares with other online information or with an expert. Albert Meige, an associate director focused on technology at consulting firm Arthur D. Little, says his own teenage daughter used it to help her with her physics homework; but he could validate the answers thanks to his doctorate in computational physics. He recommends using the chatbot to help better understand questions being posed in homework. “She discovered that she should not ask one single question,” he says. “It was an interactive process.”

Use it to get feedback, concurs Cornebise. “That’s what the star student will do.”

Being a relatively small company, OpenAI can get away with spewing out the odd alternative fact. Alphabet Inc.’s Google and Meta Platforms Inc. wouldn’t be able to do the same. Google has its own highly-sophisticated language model called LaMDA, but is ultra-cautious about integrating a similar chatbot into its own search tool, likely in part because of the accuracy problem. Three days after it released an AI tool that could generate scientific papers, called Galactica, Meta took it down after scholars criticized it for generating untrustworthy information.

OpenAI will be held to similarly high standards as the generative AI arms race heats up and chatbot technology gets integrated into search engines in the US and China.

Until then, use it with discretion and a healthy dose of skepticism, especially in education.

Parmy Olson is a Bloomberg Opinion columnist covering technology. A former reporter for the Wall Street Journal and Forbes, she is author of “We Are Anonymous.”

Talk to us

> Give us your news tips.

> Send us a letter to the editor.

> More Herald contact information.

More in Opinion

toon
Editorial cartoons for Wednesday, May 21

A sketchy look at the news of the day.… Continue reading

A visitor takes in the view of Twin Lakes from a second floor unit at Housing Hope’s Twin Lakes Landing II Wednesday, Feb. 22, 2023, in Marysville, Washington. (Ryan Berry / The Herald)
Editorial: Housing Hope’s ‘Stone Soup’ recipe for community

With homelessness growing among seniors, an advocate calls for support of the nonprofit’s projects.

Burke: Don’t let Trump & Co. get away with ‘no comment’ on outrages

For the tiring list of firings, cuts, busted norms and unconstitutional acts, hold them accountable.

Opposition to amendment to habitat rules ignored

The article regarding Snohomish County’s habitat ordiance reports a preponderance of Snohomish… Continue reading

DIYers should get a PUD’s heat-pump break, too

I have just completed a do-it-yourself installation of a central heat pump… Continue reading

Everett Council, Dist. 2: Paula Rhyne has proved herself

Four years ago, a public servant ran for District 2 and won… Continue reading

Comment: Era of Buffett-, Gates-style philanthropy is ending

The tech billionaires see their space and AI quests as better than a bequest to fight poverty and disease.

Wildfire smoke builds over Darrington on Friday, Sept. 11, 2020 in Darrington, Wa. (Olivia Vanni / The Herald)
Editorial: Loss of research funds threat to climate resilience

The Trump administration’s end of a grant for climate research threatens solutions communities need.

Sarah Weiser / The Herald
Air Force One touches ground Friday morning at Boeing in Everett.
PHOTO SHOT 02172012
Editorial: There’s no free lunch and no free Air Force One

Qatar’s offer of a 747 to President Trump solves nothing and leaves the nation beholden.

The Washington State Legislature convenes for a joint session for a swearing-in ceremony of statewide elected officials and Governor Bob Ferguson’s inaugural address, March 15, 2025.
Editorial: 4 bills that need a second look by state lawmakers

Even good ideas, such as these four bills, can fail to gain traction in the state Legislature.

toon
Editorial cartoons for Tuesday, May 20

A sketchy look at the news of the day.… Continue reading

Douthat: What guides Trump policy is a doctorine of the deal

Hawk or dove, former friend or foe; what matters most is driving a bargain, for good or ill.

Support local journalism

If you value local news, make a gift now to support the trusted journalism you get in The Daily Herald. Donations processed in this system are not tax deductible.