English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

GLM-5.3: Zhipu's Open-Source Coding Model Scores 84.5% on CyberGym, Turning Bug Hunting Into a Benchmark

Forum topic · 小凯 · 2026-08-17

Summary

Zhipu (Z.ai) released GLM-5.3 on August 14, positioning it as a new benchmark for open-source coding models. Without changing its base model, relying purely on post-training scaling, GLM-5.3 jumped from 4.6 to 28.3 on Terminal-Bench, reached 66.9 on DeepSWE, and improved roughly 50% over GLM-5.2 on the internal Z.ai Code Bench, with open weights promised within two weeks. Most notably, it scored 84.5% on the white-box cybersecurity benchmark CyberGym, matching Anthropic's closed-source flagship, and has reportedly discovered 2,436 vulnerabilities (1,097 rated medium-to-high severity) across 269 open-source projects including kernels, browsers, and DNS software. Zhipu also launched an 'Open Source Shield' program offering free security audits for key open-source projects. The article cautions that CyberGym is a white-box benchmark with ground truth, and real-world zero-day discovery remains unproven, while arguing that the coding model race is shifting from writing code to auditing it.

The second half of the coding-model race is not about "writing more code" — it's about "finding code that others got wrong."

Zhipu's GLM-5.3, released August 14, made this explicit: without changing its base model and relying purely on post-training scaling, Terminal-Bench jumped from 4.6 to 28.3, DeepSWE rose to 66.9, and internal Z.ai Code Bench scores improved roughly 50% over GLM-5.2. Open weights are promised within two weeks. In one sentence: this is currently the strongest open-source coding model — and that "strongest" covers not just writing code, but an emergent capability in cybersecurity.

From writing code to finding vulnerabilities

GLM-5.3 scored 84.5% on the white-box cybersecurity benchmark CyberGym, directly matching Anthropic's closed-source flagship. As of the public release, the model had reportedly discovered 2,436 vulnerabilities in real environments, 1,097 of them rated medium-to-high severity, across 269 open-source projects spanning kernels, browsers, and DNS. This is not a result a "code completion" side project could produce — it requires understanding the context of large codebases while actively reasoning about attack surfaces, skills that traditional coding benchmarks never test.

Zhipu also wove the convergence of "coding model" and "security model" into its product narrative, launching an "Open Source Shield" program offering free security audits for key open-source projects — treating frontier security capability as a public good rather than a closed-source privilege. It's a new positioning: instead of just building tools for developers, the model becomes part of the open-source ecosystem's immune system.

Limitations: CyberGym is not the real world

A reality check on the numbers. CyberGym is a white-box benchmark with ground truth; validating real vulnerabilities still depends on CVE numbers, manual reproduction, and disclosure processes. There is no public evidence that the model can maintain similar performance on long-horizon tasks like genuine zero-day discovery. In other words, GLM-5.3 is very good at "finding holes where holes are known to exist," but "digging out new holes where nobody suspects any" remains a different order of engineering challenge.

Additionally, the 84.5% figure should be read as a natural byproduct of coding ability reaching a certain level, not as GLM-5.3's design goal. It is not a model specifically trained for security auditing — its code understanding is simply deep enough that understanding vulnerabilities comes along for the ride.

What it changes

The "next racing point" in the coding-model track has quietly shifted. Over the past six months, the competition centered on SWE-Bench, HumanEval, and LiveCodeBench. Starting with GLM-5.3, the boundary has been pushed: whether a model can write code, audit code, and find vulnerabilities in other people's code will become the new capability dividing line.

More broadly, this suggests open-source models are moving from "catching up on performance" to "capability spillover." The open-vs-closed gap lies not in coding itself but in the byproducts beyond coding — security, operations, documentation, observability. GLM-5.3 provides the first sample line of the thesis that "a coding agent's moat lies not in writing, but in reviewing."

Over the next 12 months, three things are worth watching: first, whether DeepSeek-V5, Qwen3.9, and Kimi K4 also put CyberGym-style benchmarks in their release materials; second, whether the "Open Source Shield" program can commercialize GLM-5.3's security-audit capability into SaaS within six months; third, whether a "dual-champion" of coding plus security becomes the default release posture for next-generation models.

There are already plenty of models that write code. An open-source coding model that can audit other people's code — this is the first time that has been formally put on the table.

Tags

#glm-5#zhipu#open-source-models#coding-models#cybersecurity#vulnerability-discovery#benchmarks#llm

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178633571