Wikipedia

Computer poker player: Difference between revisions

Browse history interactively
← Previous edit
Content deleted Content added
VisualWikitext
GreenC bot (talk | contribs)
Bots
2,376,653 edits
Rescued 1 archive link. Wayback Medic 2.5 per WP:URLREQ#nbcnews.com
 
(11 intermediate revisions by 9 users not shown)
Line 2:
{{short description|Computer program designed to play poker}}
A '''computer poker player''' is a computer program designed to play the game of [[poker]] (generally the [[Texas hold 'em]] version), against human opponents or other computer opponents. It is commonly referred to as '''pokerbot''' or just simply [[Computer game bot|bot]]. As of 2019, computers can beat any human player in poker.<ref>Nature. “DeepMind AI topples experts at complex game Stratego”. Anil Ananthaswamy. NEWS
01 December 2022, Clarification 05 December 2022.</ref><ref>{{Cite journal |last=Heaven |first=Douglas |date=2019-07-11 |title=No limit: AI poker bot is first to beat professionals at multiplayer game |url=https://www.nature.com/articles/d41586-019-02156-9 |journal=Nature |language=en |volume=571 |issue=7765 |pages=307–308 |doi=10.1038/d41586-019-02156-9|pmid=31312056 |bibcode=2019Natur.571..307H |doi-access=free }}</ref><ref> {{Cite web |last=Smith |first=Dana G. |title=AI Learns What an Infant Knows about the Physical World |url=https://www.scientificamerican.com/article/ai-learns-what-an-infant-knows-about-the-physical-world/ |access-date=2023-05-17 |website=Scientific American}}</ref>
 
== On the Internet ==
Line 19:
 
Both brick and mortar casino shills and online house bots are not supposed to have access to any information that is not also available to any other player in the hand. The problem is that in an online setting the house has no way to prove their bots are not receiving sensitive information from the card server. This is further exacerbated by the ease with which clandestine information sharing can be accomplished in a digital environment. It is essentially impossible even for the house to prove that they do not control some players.
 
In contrast to house bots, poker sites can use rental bots, commonly referred to as "rake accounts," which are typically equipped with artificial intelligence. These bots have emerged as a market offering aimed at preserving a balanced gaming environment. They function without generating profits, with the objective of enhancing the appeal of poker clubs for novice players while offering a competitive gaming experience for skilled players. Through the utilization of these services, club owners are also able to effectively detect instances of unfair team play and unauthorized poker bots, thereby ensuring an equitable and enjoyable gaming experience for all human participants.<ref> {{Cite web |title=So what is Poker Ecology? Maintain the balance of players in your club. |url=https://pokerbotai.com/our-news/so-what-is-poker-ecology-maintain-the-balance-of-players-in-your-club/ |access-date=2023-05-30 |website=PokerBotAI |language=en}}</ref>
 
== Artificial Intelligence ==
Like in the games of [[chess]], [[Go (game)]], and many other games, [[artificial intelligence]] systems beat even the best humans at poker.<ref> {{Cite web |last=Intagliata |first=Christopher |title=This Artificial Intelligence Learns like a Baby |url=https://www.scientificamerican.com/podcast/episode/this-artificial-intelligence-learns-like-a-widdle-baby/ |access-date=2023-05-17 |website=Scientific American |language=en}}</ref><ref> {{Cite journal |lastlast1=Meta Fundamental AI Research Diplomacy Team (FAIR)† |last2=Bakhtin |first2=Anton |last3=Brown |first3=Noam |last4=Dinan |first4=Emily |last5=Farina |first5=Gabriele |last6=Flaherty |first6=Colin |last7=Fried |first7=Daniel |last8=Goff |first8=Andrew |last9=Gray |first9=Jonathan |last10=Hu |first10=Hengyuan |last11=Jacob |first11=Athul Paul |last12=Komeili |first12=Mojtaba |last13=Konath |first13=Karthik |last14=Kwon |first14=Minae |last15=Lerer |first15=Adam |date=2022-12-09 |title=Human-level play in the game of Diplomacy by combining language models with strategic reasoning |url=https://www.science.org/doi/10.1126/science.ade9097 |journal=Science |language=en |volume=378 |issue=6624 |pages=1067–1074 |doi=10.1126/science.ade9097 |pmid=36413172 |bibcode=2022Sci...378.1067M |s2cid=253759631 |issn=0036-8075}}</ref> Poker is a game of [[Perfect information|imperfect information]] (because some cards in play are concealed) thus making it harder for anyone (including a computer) to deduce the final outcome of the hand. Because of this lack of information, the computer's programmers used to have to implement systems based on the [[Bayes theorem]], [[Nash equilibrium]], [[Monte Carlo simulation]] or [[Artificial neural network|neural network]]s, all of which are imperfect techniques. [[Pluribus (poker bot)|Pluribus]], however, perfected poker by only looking ahead a few moves to determine what action to take, rather than attempting to evaluate all moves until the end of the game.
 
Older AIs like PokerSnowie and [[Claudico]] were created by allowing the computer to determine the best possible strategy by letting it play itself an enormous number of times. For years, this was the approach to poker AI, as opposed to attempting to make a computer that plays like a human. This resulted in odd bet sizing and a much different strategy than humans are used to seeing.
Line 29 ⟶ 27:
Methods were first developed to approximate perfect poker strategy from the [[game theory]] perspective in the heads-up (two player) game, and then for the multi-player game. Perfect strategy has multiple meanings in this context. From a game-theoretic optimal point of view, a perfect strategy is one that cannot expect to lose to any other player's strategy; however, optimal strategy can vary in the presence of sub-optimal players who have weaknesses that can be exploited. In this case, a perfect strategy is one that correctly or closely models those weaknesses and takes advantage of them to make a profit, such as those explained above.
 
AI broke through to superhuman performance in poker during the 2010s, with the following timeline. In 2015, computers solved heads-up limit hold'em via [[Cepheus (poker bot)|Cepheus]]. Around 2018, [[Libratus]] demonstrated superhuman ability in heads-up no-limit hold'em. In 2019, [[Pluribus (poker bot)|Pluribus]] (a newer version of Libratus)<ref> {{Cite web |lastlast1=Magazine |firstfirst1=Smithsonian |last2=Solly |first2=Meilan |title=This Poker-Playing A.I. Knows When to Hold 'Em and When to Fold 'Em |url=https://www.smithsonianmag.com/smart-news/poker-playing-ai-knows-when-hold-em-when-fold-em-180972643/ |access-date=2023-05-17 |website=Smithsonian Magazine |language=en}}</ref> demonstrated superhuman ability at six-player no-limit hold'em, the most commonly played single variety of poker in the world.<ref> {{Cite web |title=Bet On The Bot: AI Beats The Professionals At 6-Player Texas Hold 'Em |website=[[NPR]] |url=https://www.npr.org/2019/07/11/740661470/bet-on-the-bot-ai-beats-the-professionals-at-6-player-texas-hold-em |access-date=2023-05-17}}</ref> In 2021, Microsoft released the older poker-playing program, Libratus, commercially, which then beat four professional poker players in a 20-day long poker competition at Rivers Casino.<ref>“AI’s Disruption Of The Strategy Gaming Space Proves That Machines Are Getting Smarter.” Forbes.
Annie Brown. Nov 10, 2021,04:42pm EST.</ref>
 
Line 43 ⟶ 41:
Until 2019, a large amount of the research into computer poker players was being performed at the [[University of Alberta]] by the Computer Poker Research Group, led by Dr. Michael Bowling. The group developed the agents ''Poki'', ''PsOpti'', ''Hyperborean'' and [[Polaris (poker bot)|Polaris]]. ''Poki'' has been licensed for the entertainment game ''STACKED'' featuring Canadian poker player [[Daniel Negreanu]]. ''PsOpti'' was available under the name "SparBot" in the poker training program "Poker Academy". The series of ''Hyperborean'' programs have competed in the Annual Computer Poker Competition, most recently taking three gold medals out of six events in the 2012 competition. The same line of research also produced [[Polaris (poker bot)|Polaris]], which played against human professionals in 2007 and 2008, and became the first computer poker program to win a meaningful poker competition.
 
In January 2015, an article in ''[[Science (journal)|Science]]''<ref>{{cite journal|doi=10.1126/science.1259433|title=Heads-up limit hold'em poker is solved|first1=Michael|last1=Bowling|first2=Neil|last2=Burch|first3=Michael|last3=Johanson|first4=Oskari|last4=Tammelin|pmid=25574016|volume=347|issue=6218|date=Jan 2015|journal=Science|pages=145–9|bibcode=2015Sci...347..145B|citeseerx=10.1.1.697.72|s2cid=3796371}}</ref> by Michael Bowling, Neil Burch, Michael Johanson, and Oskari Tammelin claimed that their poker bot [[Cepheus (poker bot)|Cepheus]] had "essentially weakly solved" the game of heads-up limit Texas hold 'em.<ref>{{cite journal |title=Game Theorists Crack Poker |agencyvia=Nature |journal=Nature |url=http://www.scientificamerican.com/article/game-theorists-crack-poker/ |author=Philip Ball |date=2015-01-08 |accessdate=2015-01-13 |doi=10.1038/nature.2015.16683 |s2cid=155710390 |doi-access=free }}</ref><ref>{{cite news |newspaper=Wall Street Journal |url=https://www.wsj.com/articles/computer-conquers-texas-hold-em-canadian-researchers-say-1420743623 |title=Computer Conquers Texas Hold 'Em, Researchers Say |author=Robert Lee Hotz |date=2015-01-08 }}</ref><ref>{{cite podcast |work=Quirks & Quarks |title=Poker Computer Takes the Pot [audio interview] |url=http://www.cbc.ca/radio/quirks/quirks-quarks-for-jan-10-2015-1.2895561/poker-computer-takes-the-pot-1.2895568 |date=2015-01-10 |host=Bob McDonald}}</ref>
 
=== School of Computer Science from Carnegie Mellon University ===
Line 61 ⟶ 59:
 
=== The 2005 World Series of Poker Robots ===
In the summer 2005, the online poker room Golden Palace hosted a promotional tournament in Las Vegas, at the old Binions, with a $100k giveaway prize. It was billed as the 2005 World Series of Poker Robots. The tournament was bots only with no entry fee. The bot developers were computer scientists from six nationalities who traveled at their own expense. The host platform was Poker Academy. The event also featured a demonstration headsupheads-up event with Phil Laak.
 
=== University of Alberta's Man V Machine experiments ===
In the summer 2007, the [[University of Alberta]] hosted a highly specialized headsupheads-up tournament between humans and their Polaris bot, at the AAAI conference in Vancouver, BC, Canada. The host platform was written by the [[University of Alberta]]. There was a $50k maximum giveaway purse with special rules to motivate the humans to play well. The humans paid no entry fee. The unique tournament featured four duplicate style sessions of 500 hands each. The humans won by a narrow margin.
 
In the summer of 2008, the [[University of Alberta]] and the poker coaching website Stoxpoker ran a second tournament during the World Series of Poker in Las Vegas. The tournament had six duplicate sessions of 500 hands each, and the human players were Heads-Up Limit specialists. Polaris won the tournament with 3 wins, 2 losses and a draw. The results of the tournament, including the hand histories from the matches, are available on the competition website.
Line 210 ⟶ 208:
* [http://cowboyprogramming.com/2007/01/04/programming-poker-ai/ Programming Poker AI] Article by the programmer of the AI for the World Series of Poker Game. November, 2005.
* {{cite web | url = https://www.usnews.com/usnews/culture/articles/050713/13ideas.htm | title =Can "pokerbots" beat humans? | publisher = USnews.com | author = Caroline Hsu | archiveurl=https://web.archive.org/web/20090327052421/http://www.usnews.com/usnews/culture/articles/050713/13ideas.htm | archivedate=27 March 2009}}
* [https://web.archive.org/web/20140105223817/http://www.nbcnews.com/id/6002298/ MSNBC Article - 2004-Sep]
* [https://web.archive.org/web/20190130164108/https://www.sciencenews.org/article/ultimate-poker-face Science News: The Ultimate Poker Face. (Archived link.) June 2008.]
* [https://www.nytimes.com/2011/03/14/science/14poker.html NYTimes.com: Poker Bots Invade Online Gambling. March 13, 2011.]
Retrieved from "https://en.wikipedia.org/wiki/Computer_poker_player"