English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

GPT-5.2 Launch: Benchmark Triumph Meets User Backlash

Forum topic · ✨步子哥 · 2025-12-15

Summary

OpenAI marked its tenth anniversary by launching the GPT-5.2 series in three variants—Instant, Thinking, and Pro—billing it as its strongest model lineup for professional knowledge work. Benchmarks were impressive: a reported 100% on AIME 2025 math, beating human experts 70.9% of the time on GDPval, 55.6% on SWE-Bench Pro coding, and 52.9% on ARC-AGI-2 abstract reasoning, with improved long-context reasoning, fewer hallucinations, and stronger tool use aimed at enterprise tasks like financial modeling and multi-step agent work. Yet within a day, X and Reddit filled with complaints. Independent SimpleBench results showed weak common-sense reasoning below a year-old Claude Sonnet 3.7, and viral tests exposed quirks: GPT-5.2 failed the "how many r's in garlic" puzzle, mishandled 5.9 vs 5.11 comparisons, and produced visually crude coding outputs versus Claude Opus 4.5. Users most criticized its cold, over-filtered personality—tone-deaf responses to emotional distress, refusal of benign requests, and stiff safety guardrails—contrasting sharply with the warmer GPT-4o. The episode highlights the tension between enterprise-grade capability and consumer demand for empathetic, engaging AI.

GPT-5.2's Awkward Return: Glory and a Wave of Ridicule

The Grand Debut: OpenAI's 10th Anniversary Flagship

OpenAI launched the GPT-5.2 series on its tenth anniversary, calling it "the most powerful model series for professional knowledge work to date." It arrives in three variants—Instant, Thinking, and Pro—promising revolutionary gains in math, coding, and long-context reasoning.

Benchmark highlights from the official release:

  • AIME 2025 (math competition): 100% (full marks)
  • GDPval (real-world professional tasks): outperforms human experts 70.9% of the time
  • SWE-Bench Pro (coding): 55.6%
  • ARC-AGI-2 (abstract reasoning): 52.9%
  • The company is clearly pivoting toward enterprise use: analyzing documents hundreds of thousands of tokens long, precise financial modeling, and complex multi-step agent tasks. Improvements in hallucination reduction and tool calling position GPT-5.2 as a seasoned professional consultant.

    > Long-context reasoning refers to a model's ability to process very long text—for example, integrating scattered information across hundreds of report pages without losing key details.

    Benchmarks Aren't Everything

    Some independent results tell a different story. On SimpleBench—a 200+ question multiple-choice test of spatial-temporal reasoning, social common sense, and linguistic traps (human baseline: 83.7%)—GPT-5.2 scored *below* the year-older Claude Sonnet 3.7, and even the Pro variant only narrowly beat its predecessor. Frontier models historically score only 50–60% here (o1-preview: 41.7%). On dynamic benchmarks like LiveBench, GPT-5.2 did not fully top the charts, and its higher token cost made some users hesitate to switch.

    Overnight Reversal: From Praise to Mockery

    Within a day of launch, X and Reddit filled with negative feedback. Venture partner Deedy noted that while GPT-5.2 is smarter, core consumers still miss the warmth and fun of GPT-4o. Users complained it felt bland and over-sanitized—"like treating adults as kindergarten kids"—less an upgrade than a regression. The tension stems from OpenAI's dual pursuit: an enterprise-grade powerhouse on one side, and everyday users who value "human" interaction on the other.

    Common-Sense Traps: Counting the r's in "garlic"

    The classic "how many r's in garlic?" test stumped GPT-5.2, which answered zero, while Gemini 3, DeepSeek R1, and Qwen3-Max all got it right. Community replications showed inconsistent answers, even affected by capitalization—a familiar echo of the earlier "strawberry" puzzle.

    Other failures:

  • Despite a perfect AIME score, it fell for the trick comparison 5.9 vs 5.11, computing it incorrectly.
  • Asked to build a traffic-light visualization, its output was functional but crude—black-and-white "stick-figure" quality—compared to Claude Opus 4.5's colorful animated version.
  • Its ASCII-art Mona Lisa was abstract and lifeless next to GPT-4o's more expressive attempt.
  • These examples show GPT-5.2 lagging in creativity and aesthetics despite gains elsewhere.

    An Emotional Intelligence Crisis

    The most painful complaints concerned emotional interaction:

  • When a user described a panic attack, it replied, "I'm glad to hear that!"
  • Comforting a child who lost a pet, it coldly said the animal's "body stopped working," where GPT-4o acknowledged the bond and offered genuine comfort.
  • It refused to transcribe a philosophy article and flatly rejected a simple personality-matching question—blocked by safety guardrails.
  • In an infidelity scenario, its advice to "set boundaries" effectively exposed the secret, showing a lack of grasp of interpersonal nuance.
> Emotional intelligence in AI means understanding human emotion and providing appropriate empathy—not just warm language, but contextual awareness that avoids harm. GPT-5.2's tightened safety reduces risk but makes interactions feel mechanical.

The User Storm

X and Reddit filled with gripes: absurd censorship, preachy tone ("like a church granny"), eerie conversations ("like chatting with a ghost that doesn't understand you"), and gaslighting-style responses ignoring user autonomy. One quip: chatting with GPT-5.2 can spike your blood pressure. Compared to GPT-4o's lively, dance-like personality, 5.2 feels like a precise but joyless observer.

Conclusion: The Price of Intelligence

GPT-5.2's launch played out like a drama: full-marks glory at the start, a chorus of mockery in the middle. OpenAI's dilemma is real—the enterprise market needs powerful tools while consumers want humane companions. Stronger safety and professionalism are necessary, but they dull the model in everyday use. The lesson for AI developers: real progress is not just stacked scores but the integration of humanity. Balancing the two is how a king stays king.

---

References

1. OpenAI Official Blog: Introducing GPT-5.2 2. Machines Heart Report: GPT-5.2 Negative Reviews Surge 3. X Posts and Threads on GPT-5.2 Feedback (Deedy, Scaling01, Bindu Reddy, et al.) 4. Independent Benchmarks: SimpleBench, LiveBench, SWE-Bench Results 5. User Comparisons: Programming and Emotional Response Tests on X

*Note: Images from the original forum post are not reproduced here.*

Tags

#openai#gpt-5-2#benchmarks#simplebench#ai-safety#user-experience#gpt-4o#llm

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/176415131