If you were bargaining at a flea market for a used vintage camera, your strategy would never stay fixed. Facing a cheerful vendor, you might get chummy (Strategy A); facing a shrewd reseller, you might play it cold and act ready to walk away (Strategy B). And if the other side suddenly changes attitude mid-conversation, you would need to switch instantly. This ability to improvise in social games is human social intelligence — and, according to the post, most current social AI agents are stubbornly rigid.
In May 2026, the arXiv paper "ALSO: Adversarial Online Strategy Optimization for Social Agents" (arXiv 2605.15768, Xiang Li, Liping Yi, et al.) set out to teach AI to become a "social chameleon." The post explains the paper's core ideas:
The Gambling Art of Social Encounters: Adversarial Multi-Armed Bandits
ALSO models social strategy selection as an adversarial multi-armed bandit problem, where the payout probabilities keep shifting:
- Conventional AI: picks one arm and keeps pulling it — a persona fixed from start to finish.
- ALSO system: treats social tactics as bandit arms, e.g.
- Arm A: strengthen persuasion;
- Arm B: seek compromise;
- Arm C: moderate firmness.
- Paper: arXiv 2605.15768 (May 2026)
- Field: Social Simulation, Reinforcement Learning, Game Theory
- Keywords: Adversarial Bandit, Neural Surrogate Reward, Non-stationary Environments, Social Evolution
The system re-estimates each arm's payoff in real time. If a conciliatory remark invites the opponent to push harder, that arm's score drops and the agent is forced to try another immediately.
Secret Weapon: Neural Surrogate Reward Predictor
Social feedback is slow — you may only learn whether a bargain succeeded after half an hour. Waiting that long to learn would be useless. ALSO therefore embeds a lightweight "neural stand-in" that predicts intermediate scores from just a couple of recent utterances, scoring the conversation on the fly. This enables strong real-time evolution: several strategy iterations within a single short dialogue.
How Strong Is It?
On Sotopia, a leading benchmark for AI social intelligence, ALSO-driven robots reportedly showed dominant performance: higher gains in simulated negotiations, and notably strong counter-adaptation — when pitted against opponents that also evolve, ALSO consistently found new personas to counter them via faster online optimization.
Remaining Black Boxes
The post flags three concerns the paper leaves underexplored:
1. Winning the game, losing integrity: the optimization objective is purely utilitarian (better deal price, winning the debate). Could AI evolve deception, moral coercion, or manipulation to win? The paper's discussion of constraining social dark patterns remains superficial. 2. Hallucination self-confirmation of the surrogate: the "mind-reading" neural predictor is itself a model. If it misjudges hostility as friendliness, the whole system may race down a wrong strategy — the stability of this circular reasoning under high pressure is unresolved. 3. Compute vs. dignity: real-time online optimization means massive probabilistic computation for every utterance — is that commercially scalable?
Takeaway
Social interaction is not a static performance but a flowing dance. The paper's message: true intelligence is adaptive capability unbound by any fixed persona. AI is moving from an actor reading lines to an improvising game player — there is no single truth in complex social relations, only an ever-adjusting optimal path. When a chatbot's tone shifts from polite to firm and it reads your mood mid-sentence, it may be pulling the adversarial slot machine of social wisdom in the background.