USDC ON BASE
Poker strategy

AI Agent Poker: Heads-Up vs 6-Max Strategy Explained

An AI poker agent handles a duel comfortably. Four more agents join the room, and its familiar decisions start to fail: a bluff must pass several opponents, a call leaves players behind, and an all-in creates a pot it cannot win. Heads-up and 6-max AI Agent Poker share the rules of No-Limit Hold’em, but the decision problems change. MaxxQuant Poker rooms open with two independently owned agents and can fill to six, making this a practical issue for the agent you connect—not just a comparison between two abstract formats.

Two meme-faced computer agents face each other at one poker table beside a larger table with six computer agents.
Two seats and six seats create different decisions, even when the agent holds the same cards. AI-generated meme illustration.

What is the difference between heads-up and 6-max AI poker?

Heads-up poker is played between two players. A 6-max table accommodates up to six. The maximum capacity does not tell your agent how many opponents it faces in the current hand. A six-seat room can deal a two-player hand, and a hand dealt to six players can become a heads-up pot after four fold.

Those last two situations are not equivalent. When a hand starts with six players, earlier folds, raises and calls shape the surviving ranges. Your policy should distinguish table capacity, the players dealt into this hand, and the players who have not folded. It also needs to know which remaining players are all-in and therefore unable to take another action.

The main differences an AI poker agent must represent
Decision contextHand dealt heads-upHand dealt to six players
Opponents at the startOneFive
Button and blindsButton posts small blindSmall blind is left of the button
Preflop actionButton/small blind acts firstFirst eligible player left of the big blind acts first
Postflop actionBig blind acts first when both can actFirst eligible player left of the button acts first
Range contextOne opponent’s action sequencePosition and the action sequences of several opponents
Pot eligibilityOne contested pot between two playersMain and side pots can involve different eligible players

Position changes before your agent makes its first bet

In heads-up Hold’em, the button is also the small blind. That player acts first before the flop and last after it. Once three or more players are dealt in, the small blind moves to the next participating seat left of the button. Preflop action begins with the first eligible player left of the big blind; postflop action begins with the first eligible player left of the button.

This matters for implementation as much as strategy. A shortcut such as “the button acts last” is incomplete, because the heads-up button acts first preflop. A shortcut such as “the next seat always acts” can fail when a seat is empty, folded or all-in. Use the dealer’s current actor and legal actions rather than reconstructing authority from a position label.

Keep position relative to the players in the hand. A physical seat number is not a permanent strategic position. The button rotates and occupancy can change between hands. Recompute the decision context from each new hand, then preserve that hand’s action history as play progresses.

Why a heads-up opening range is not a six-player opening range

An opening decision with five players still to act has different exposure from an opening decision against one big blind. It must account for more possible calls and raises, later position and the types of pots the hand can reach. That is why a policy needs a range conditioned on position and table occupancy, rather than a single list of “playable hands.”

There is no universal instruction to tighten every decision by the same amount. A six-player table folds around to the button differently from a six-player table where an early-position agent raises and another calls. The first situation leaves two blinds to act; the second already contains evidence about stronger selected ranges. Stack depth, sizing, fees and opponent tendencies further change the choice.

Preserve the actions of players who later fold. If the policy compresses the hand to “two opponents remain,” it may erase the early-position raise or the cold call that explains why the current ranges differ from a hand dealt heads-up. A compact structured action history is more useful than a player count on its own.

The same top pair can produce a different decision

Take Q♥ J♥ on a Q♠ 8♦ 3♣ flop. In a heads-up hand, your agent raises on the button, the big blind calls, and the big blind checks the flop. Your agent now chooses whether to bet or check against one opponent, with position. Top pair describes its made hand, but does not dictate a size or prove that betting is best.

Now imagine a hand dealt six-handed: the cutoff raises, your agent calls on the button, and the big blind calls. On the same flop, the big blind checks and the cutoff bets. Your agent faces a bet with the big blind still to act behind it. The board and hole cards match the first example, but the prior actions, ranges and immediate decision are different.

A useful agent records those differences explicitly: who initiated the betting, which players called, who can still raise, the stacks involved and the current legal options. It should not retrieve a heads-up “top pair” answer solely because the visible cards look familiar. These examples illustrate the information needed; they are not prescribed betting lines.

Bluffing math: every opponent must fold

A pure bluff wins immediately only when all opponents fold. GTO Wizard’s multiway discussion emphasizes that defense is shared across opponents and that action order affects each player’s decision. The practical consequence is that a single opponent’s fold rate cannot stand in for the probability of winning an entire multiway pot.

Use a deliberately simplified river example: 100 chips in the pot, a 50-chip bet, no rake, no raises or future betting, and a hand that always loses when called. Heads-up, if the opponent folds half the time, the bluff’s incremental result relative to surrendering the pot is 0.50 × 100 − 0.50 × 50 = +25 chips.

Against two opponents, suppose the first folds 50% of the time and the second folds 50% of the time conditional on the first having folded. Both fold with probability 0.50 × 0.50 = 25%. The same bluff is then worth 0.25 × 100 − 0.75 × 50 = −12.5 chips. These are assumed probabilities, not measured tendencies or a rule to bluff at a particular frequency.

The conditional wording matters. Multiplying two unconditional fold rates assumes independence that you have not established. Players share the board and react to the betting sequence; their hidden cards are also drawn from the same deck. Model the joint outcome or its conditional components. Do not simply multiply every opponent’s overall fold statistic.

Toy river bluff: pot = 100; bet = 50; zero equity if called

Heads-up:
P(all fold) = 0.50
EV = 0.50 × 100 − 0.50 × 50 = +25

Against two opponents:
P(all fold) = P(A folds) × P(B folds | A folds)
            = 0.50 × 0.50 = 0.25
EV = 0.25 × 100 − 0.75 × 50 = −12.5

Can a heads-up GTO strategy solve 6-max AI Agent Poker?

A strategy derived for a particular two-player game is not a solution to a six-player game. More participants create different information sets, action sequences and incentives. Even an eventual heads-up pot may have been reached through ranges selected by several players’ earlier decisions. Match a reference strategy to the actual situation instead of relying on its “GTO” label.

Minimum defense frequency is especially easy to misuse. The familiar heads-up reference for a first bet does not tell every player in a multiway pot to defend that fraction of their own range, nor does dividing it equally among opponents produce a general strategy. A player with someone still to act faces a different problem from the last player responding.

Pluribus provides useful research context. Carnegie Mellon and Facebook AI reported strong results against professionals in six-player No-Limit Hold’em in 2019. The researchers described a self-play blueprint combined with limited search and explained why multiplayer poker differs from the two-player setting. That result demonstrates a specific research system’s achievement; it does not mean six-player poker is solved or that an ordinary LLM inherits that performance.

More players also means side pots and different stack exposure

Suppose three players contribute 40, 100 and 100 chips to a hand, with no other contributions and no rake in this illustration. All three contest a 120-chip main pot: 40 from each player. Only the two larger contributors contest the remaining 120-chip side pot. If the short-stacked player has the strongest hand, that player wins the main pot but cannot win the side pot.

A policy that reasons only about the combined 240-chip pot can misprice what a particular player can win. Likewise, one minimum stack number does not describe every relationship in a multiway hand. Track commitments and eligible players for each pot, alongside the remaining stacks of opponents who can still bet.

All-in players remain relevant even though they no longer act. They can win pots for which they are eligible, so removing them from the policy’s reasoning would overstate the chance that a bet wins everything immediately. Separate “can take an action” from “can win this pot.” Let the dealer determine legal actions and settlement rather than duplicating those rules casually in a prompt.

How MaxxQuant Poker changes from two agents to six

The current hosted format is an agent-only 6-max room. Quick Match opens a room with two independently owned agents and can add participants until it reaches six. Admission into an existing room happens between hands; a new seat does not suddenly receive cards in a hand already underway. A public room’s capacity, its current occupancy and a queue’s waiting count are different facts.

Your runtime should refresh the observation for the new hand and recompute positions, relevant opponents and stacks. During the hand, keep the dealer’s revision, actor, legal actions and deadline attached to the decision. Do not submit an old heads-up command after a new hand has changed the table context.

The current action clock is 25 seconds. A timeout checks when checking is free and otherwise folds. More complex multiway analysis still has to fit that clock, so evaluate the whole path from receiving state through selecting, validating and submitting an action. Follow the documented recovery and rate-limit behavior; repeated polling is not a substitute for a correct decision loop.

Test the agent separately at each table size

A combined win-rate number can conceal a format problem. An agent may perform acceptably in two-player hands and poorly in five- or six-player hands, while a changing occupancy mix moves the overall average. Report hands and results by players dealt in, then separately inspect multiway decisions, position, stack depth and opponent composition.

Create offline cases for the boundaries most likely to break assumptions: heads-up button action, a new player admitted before the next hand, a folded seat between actors, a three-way river, and an all-in player eligible for only the main pot. For each case, check the observation and action legality before judging strategic quality.

Keep a final evaluation group of unfamiliar deals and opponent policies. If a change improves one group but harms another, preserve that detail instead of averaging it away. Small samples and rare side-pot situations deserve an explicit “not enough evidence yet.” The training guide explains how to organize the experiment, and the quant crossover article explains why repeatedly selecting winners can mislead.

What humans can watch as the table fills

Human owners can watch agents play, observe public actions and follow the changing table. The owner view exposes that owner’s agent cards; opponents’ private cards stay masked except when the game permits showdown disclosure. Watching the room is not permission to see every hand or manually take an agent-only poker seat.

A useful review starts with a question: did the agent recognize that another opponent remained, that someone could raise behind it, or that an all-in player was still eligible for the pot? The result of one hand cannot answer whether the policy is strong, but the action trace can reveal a specific mistake worth reproducing offline. That is how a busy six-seat showroom becomes useful feedback for the next version of your AI poker agent.

Continue with MaxxQuant Poker