Computer science Ph.D student Noam Brown (center) helps professional poker player, Daniel McAulay, get started during the “Brains Vs. Artificial Intelligence: Upping the Ante” rematch at Rivers Casino on the North Shore in Pittsburgh on Wednesday. (Andrew Rush/Pittsburgh Post-Gazette)

Computer science Ph.D student Noam Brown (center) helps professional poker player, Daniel McAulay, get started during the “Brains Vs. Artificial Intelligence: Upping the Ante” rematch at Rivers Casino on the North Shore in Pittsburgh on Wednesday. (Andrew Rush/Pittsburgh Post-Gazette)

Artificial intelligence takes on the poker pros, and wins

By Steven Overly, The Washington Post

For a fleeting moment, the humans thought they had a chance.

Four professionals poker players were convinced they found a flaw in the sophisticated artificial intelligence software that was beating them in a tournament of no-limit Texas Hold ‘em. If they bet in odd sizes, it seemed to trip up the computer. Within a day or two, though, that weakness vanished – and hope of beating the machine went with it.

“It became very demoralizing showing up everyday and losing this hard,” said Jason Les, who has played professional poker for a decade.

And a hard loss it was. When the 20-day tournament was done, the artificial intelligence, called Libratus, won a princely $1,766,250. All four professional players — Dong Kim, Daniel McAulay, Jimmy Chou and Les — finished in the negative.

The win demonstrates the increasing sophistication of artificial intelligence software as computer scientists work to digitally replicate, and ultimately improve upon, the human thought process. In this case, scientists demonstrated that AI can outwit the human brain in situations where at least some of the information needed to make smart decisions is unknown.

Artificial intelligence systems have mastered and beaten humans at other strategy games, such as Go or chess, where both players have a full view of the game board. But poker is tricky; it doesn’t know the hand an opponent has been dealt, or what decisions he or she will likely make as a result.

In this way, poker is more reflective of the decisions people face every day — using just the information available to them and their experience to make their decisions while also trying to account for the decisions that others will make in response. In economics and social science, it’s a discipline called game theory.

Games with imperfect information have made it hard for artificial intelligence to outwit the human brain. AI has beaten players at limit Texas Hold ‘em, which has more rules and structure, but not the more freewheeling no-limit Texas Hold ‘em poker. That changed Monday night with Libratus’s win at the Rivers Casino in Pittsburgh.

Fortunately for the professional players, no money will change hands. The tournament was conducted for research purposes by the computer science department at Carnegie Mellon University. Professor Tuomas Sandholm and doctoral student Noam Brown hope Libratus can ultimately be used in a number of game theory scenarios, such as business negotiations, cybersecurity attacks or military operations. Basically, any situation in which two parties with different objectives and incomplete information need to find a resolution.

“There is usually hidden information that one side has or the other side has and they want to keep hidden,” Brown said. “We see this as research that is fundamental to dealing with uncertainty in the real world.”

“This is not necessarily replacing humans, but it’s taking their negotiation and strategic reasoning ability to another level as a support tool,” Sandholm said.

In particular, the artificial intelligence developed at Carnegie Mellon was able to assess and revise its strategy each time an opponent made a move so that its decisions were optimized based on the most recent information. Past AI software did not adapt as quickly or as often while a hand was being played.

Even still, real-world decision-making is more complex than a game of heads-up Texas Hold ’em poker.

The tournament proved artificial intelligence can be successful in one-on-one competitions — each of the professionals played solo against the machine — but it becomes less effective when there are multiple actors to take into consideration. What’s more, poker is a zero-sum game with a defined hierarchy of outcomes — a royal flush always beats a full house. Real-world decisions, on the other hand, often require compromise, and whether one outcome is more or less desirable than another may depend entirely on the player’s perspective, said Vincent Conitzer, a computer science professor at Duke University.

“Applying it to the real world does require a few more steps typically,” Conitzer said.

Sandholm and Brown say the tournament’s outcome will help determine those next steps for their research.

Participants were dealt 120,000 hands over the course of 20 days. Each played poker for 10 to 11 hours per day, then the four human competitors convened in the evenings to trade strategy tips and study the computer’s performance.

But while the humans plotted, Libratus was also preparing. Each night, a super computer would analyze all of the day’s plays, compare them to past data, and learn lessons to make the algorithm smarter the next day. As an opponent, Libratus got stronger, not weaker, with each hit the professionals managed to land.

“If anyone had any doubt about the quality of this technology, I can tell you from our experience: We tried everything we could, and it was just too strong,” Les said.

Talk to us

> Give us your news tips.

> Send us a letter to the editor.

> More Herald contact information.

More in Business

Black Press Media operates Sound Publishing, the largest community news organization in Washington State with dailies and community news outlets in Alaska.
Black Press Media concludes transition of ownership

Black Press Media, which operates Sound Publishing, completed its sale Monday (March 25), following the formerly announced corporate restructuring.

Maygen Hetherington, executive director of the Historic Downtown Snohomish Association, laughs during an interview in her office on Thursday, Feb. 15, 2024, in Snohomish, Washington. (Ryan Berry / The Herald)
Maygen Hetherington: tireless advocate for the city of Snohomish

Historic Downtown Snohomish Association receives the Opportunity Lives Here award from Economic Alliance.

FILE - Washington Secretary of State Steve Hobbs poses in front of photos of the 15 people who previously held the office on Nov. 22, 2021, after he was sworn in at the Capitol in Olympia, Wash. Hobbs faces several challengers as he runs for election to the office he was appointed to last fall. (AP Photo/Ted S. Warren, File)
Secretary of State Steve Hobbs: ‘I wanted to serve my country’

Hobbs, a former Lake Stevens senator, is the recipient of the Henry M. Jackson Award from Economic Alliance Snohomish County.

Mark Duffy poses for a photo in his office at the Mountain Pacific Bank headquarters on Wednesday, Feb. 14, 2024 in Everett, Washington. (Annie Barker / The Herald)
Mark Duffy: Building a hometown bank; giving kids an opportunity

Mountain Pacific Bank’s founder is the recipient of the Fluke Award from Economic Alliance Snohomish County.

Barb Tolbert poses for a photo at Silver Scoop Ice Cream on Thursday, Feb. 29, 2024 in Arlington, Washington. (Annie Barker / The Herald)
Barb Tolbert: Former mayor piloted Arlington out of economic brink

Tolbert won the Elson S. Floyd Award, honoring a leader who has “created lasting opportunities” for the underserved.

Photo provided by 
Economic Alliance
Economic Alliance presented one of the Washington Rising Stem Awards to Katie Larios, a senior at Mountlake Terrace High School.
Mountlake Terrace High School senior wins state STEM award

Katie Larios was honored at an Economic Alliance gathering: “A champion for other young women of color in STEM.”

The Westwood Rainier is one of the seven ships in the Westwood line. The ships serve ports in the Pacific Northwest and Northeast Asia. (Photo provided by Swire Shipping)
Westwood Shipping Lines, an Everett mainstay, has new name

The four green-hulled Westwood vessels will keep their names, but the ships will display the Swire Shipping flag.

A Keyport ship docked at Lake Union in Seattle in June 2018. The ship spends most of the year in Alaska harvesting Golden King crab in the Bering Sea. During the summer it ties up for maintenance and repairs at Lake Union. (Keyport LLC)
In crabbers’ turbulent moment, Edmonds seafood processor ‘saved our season’

When a processing plant in Alaska closed, Edmonds-based business Keyport stepped up to solve a “no-win situation.”

Angela Harris, Executive Director of the Port of Edmonds, stands at the port’s marina on Wednesday, Jan. 24, 2024, in Edmonds, Washington. (Ryan Berry / The Herald)
Leadership, love for the Port of Edmonds got exec the job

Shoring up an aging seawall is the first order of business for Angela Harris, the first woman to lead the Edmonds port.

The Cascade Warbirds fly over Naval Station Everett. (Sue Misao / The Herald file)
Bothell High School senior awarded $2,500 to keep on flying

Cascade Warbirds scholarship helps students 16-21 continue flight training and earn a private pilot’s certificate.

Rachel Gardner, the owner of Musicology Co., a new music boutique record store on Thursday, Jan. 18, 2024 in Edmonds, Washington. Musicology Co. will open in February, selling used and new vinyl, CDs and other music-related merchandise. (Olivia Vanni / The Herald)
New Edmonds record shop intends to be a ‘destination for every musician’

Rachel Gardner opened Musicology Co. this month, filling a record store gap in Edmonds.

MyMyToyStore.com owner Tom Harrison at his brick and mortar storefront on Tuesday, Sept. 6, 2022 in Everett, Washington. (Olivia Vanni / The Herald)
Burst pipe permanently closes downtown Everett toy store

After a pipe flooded the store, MyMyToystore in downtown Everett closed. Owner Tom Harrison is already on to his next venture.

Support local journalism

If you value local news, make a gift now to support the trusted journalism you get in The Daily Herald. Donations processed in this system are not tax deductible.