English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

Easy AI Daily Digest | March 17, 2026: Inference Takes Center Stage

Forum topic · 小凯 · 2026-03-27

Summary

This daily digest from the Chinese tech community covers AI industry developments for March 17, 2026. Key items include Moonshot's Attention Residuals method (reporting ~1.25x training compute savings with under 2% inference latency overhead, validated on Kimi Linear 48B), P-EAGLE parallel speculative decoding achieving up to 1.69x speedup over EAGLE-3 on B200 GPUs and integrated into vLLM 0.16.0, and NVIDIA's GTC announcements where Jensen Huang declared the era of inference. Also covered: NVIDIA's relaxed Nemotron open-source license, DLSS 5 neural rendering, Google's Gemini Embedding 2 unifying text, image, video, and audio in one vector space, OpenAI Codex surpassing 2 million weekly active users with sub-agent support, LangChain's LangGraph CLI, Perplexity Computer's Android browser control, Microsoft's GigaTIME pathology model generating ~300k virtual protein maps across 1.4M+ patients, and community projects like GraphZero (zero-copy graph engine) and an architecture-fingerprint analysis debunking claims that Hunter Alpha is a secret DeepSeek V4.

Easy AI Daily | March 17, 2026

A translated digest of AI industry news curated by the Chinese tech community.

Research & Methods

Moonshot Proposes Attention Residuals

Moonshot introduced Attention Residuals, replacing fixed residual accumulation with attention, plus Block AttnRes to handle cross-layer costs. Reported results: ~1.25x training compute savings with <2% inference latency overhead, validated on Kimi Linear 48B (3B activation). The community praises the results while questioning novelty and citation completeness—a typical "idea vs. scale validation vs. citation norms" debate.

> Links: Paper tweet thread | Paper | Discussion 1 | Discussion 2

P-EAGLE: Parallel Speculative Decoding for Inference Acceleration

P-EAGLE generates K draft tokens in one shot, removing the sequential bottleneck of traditional speculative decoding. Up to 1.69x speedup over EAGLE-3 on B200, already integrated into vLLM 0.16.0—a practical system-level acceleration for high-throughput LLM inference.

> Link: P-EAGLE paper/project

GraphZero: A Zero-Copy Graph Engine for GNNs

Frustrated by PyTorch Geometric OOM errors, a developer wrote GraphZero in C++: CSVs are compiled to binary files, memory-mapped from NVMe directly into the training process, using nanobind and OpenMP. Enables training on 50GB-scale datasets on a single machine without loading everything into RAM. Open source.

> Links: Project intro | GitHub

Hunter Alpha Is Not DeepSeek V4: Architecture Fingerprinting

A developer compared Hunter Alpha on OpenRouter via "architecture fingerprinting": its tokenizer, vocabulary, and alignment characteristics don't match the DeepSeek family, and it handles politically sensitive topics normally—debunking rumors of a secret DeepSeek V4 test model. It may be a Western model or a new player entirely.

> Link: Analysis post

LeCun's Temporal Straightening for Latent Planning

AlphaXiv highlights LeCun et al.'s Temporal Straightening for Latent Planning: "straightening" latent trajectories so Euclidean distance better approximates actual reachable progress, improving the stability and reliability of latent-space planning.

> Link: AlphaXiv feature

Infrastructure & Hardware

NVIDIA GTC: "The Era Is Inference"

At GTC, Jensen Huang repeatedly emphasized AI's "inference inflection point": Blackwell and Rubin are supply-constrained, and NVIDIA's full stack is optimized around inference. From vLLM production deployments on OCI to algorithms like P-EAGLE, vendors and open source alike are betting on cheaper, faster inference.

> Links: GTC page | "Inference inflection" commentary | vLLM on OCI deployment guide

NVIDIA Relaxes Nemotron Open-Source License

NVIDIA updated the license for Nemotron Super 3 122B A12B, removing restrictive clauses on modifications, branding, and external ethics codes—no more "terminate if guardrails aren't maintained" risk. It now resembles a conventional open model license, easing local modification and redistribution.

> Links: Reddit discussion | New license text | Change record (Hugging Face)

DLSS 5: Real-Time Frames Go Neural

Huang called DLSS 5 the biggest image-quality leap since real-time ray tracing: generative neural rendering plus relighting produces high-fidelity frames in real time while preserving geometry and assets. Not an LLM, but aligned with the trend of handing everything at runtime to neural networks.

> Link: DLSS 5 discussion

$9K Local LLM Homelab for "LLM Neuroanatomy"

A Reddit user showed off a ~$9,000 home LLM lab: 480GB RAM, 8TB SSD per GPU, used to systematically study the internals of Qwen3.5, GLM, and other models—coining "LLM neuroanatomy." Priced against cloud GPU rates, they claim it has "paid for itself."

> Link: Homelab post

Models & Capabilities

Qwen 3.5 Local Testing: The 122B "Builds Kubernetes by Itself"

Local-community tests of Qwen 3.5: the 122B-a10b was used to set up Kubernetes and troubleshoot networks via tcpdump; others wrote 110k-character long texts with its 250k context, showing strong reasoning and long-context ability. Some still prefer the 27B version overall. Running the large model remains VRAM-hungry.

> Link: Qwen 3.5 122B discussion

Qwen 3.5-9B Uncensored Distillation for Local Creative Use

The community released an "uncensored distilled" Qwen3.5-9B—fewer refusals, more creativity, aimed at role-play and elaborate prompt design—plus a 27B variant with chain-of-thought enabled by default. Built by merging weight diffs from multiple existing models, tuned for 12GB VRAM GPUs.

> Links: Announcement | Hugging Face | 27B version

Google Launches Gemini Embedding 2: Text, Image, Audio, Video in One Space

Gemini Embedding 2 (preview) is available via the Gemini API and Vertex AI, unifying text, images, video, and audio in a single vector space with support for 100+ languages—arguably more practical for retrieval, recommendation, and multimodal search teams than another chat model.

> Link: Official announcement

More Model Signals

Quick hits: Gemini-3.1-flash-lite praised for price/latency/quality balance; QuixiAI reverse-engineered and ran Qwen3.5-397B FP8 on 8×MI210 (~6 token/s); MiniMax 2.7 reportedly close to launch; the "Leanstral" architecture spotted in Mistral Small 4; SeedFold released SeedProteo, a diffusion model for all-atom protein design.

> Links: Gemini experience | Qwen FP8 run log | MiniMax 2.7 leak | Leanstral / Mistral Small 4 | SeedProteo release

Agents & Tooling

OpenAI Codex Surges Past 2M Weekly Active Users, Adds Sub-Agents

OpenAI reports Codex at 2M+ weekly active users—nearly 4x growth this year—with a new enterprise deployment team forming. Sam Altman: "hardcore developers are switching to Codex." The GPT-5.4 API hit 5 trillion tokens/day within a week, an annualized $1B in new revenue. Product-wise, Codex added sub-agents, moving toward multi-agent coding workflows.

> Links: Codex growth | Altman comments | GPT-5.4 usage/revenue | Sub-agent update | Codex × Notion event

LangChain Ships LangGraph CLI; Deep Agents Open-Sources Top Coding-Agent Workflows

LangChain released LangGraph CLI for developing and deploying complex agent flows from the command line. The community also open-sourced Deep Agents, replicating top coding-agent pipelines: task decomposition, filesystem operations, shell, sub-agents, and context management—already in LangChain's internal production and evals.

> Links: LangGraph CLI | Deep Agents | Background

Agent Knowledge Infrastructure: Context Hub, API Skill Packs, Auto-Extracted SKILL.md

Andrew Ng extended the Context Hub (chub) CLI with "documentation feedback loops" for agents; AssemblyAI released unified "skill" components across Claude Code, Codex, and Cursor so agents act on the latest API usage rather than stale memory; a paper explores automatically extracting skills from GitHub repos into SKILL.md, claiming a 40% boost in knowledge-transfer efficiency.

> Links: Context Hub | AssemblyAI skill components | Skill extraction paper

Hermes vs OpenClaw: Open-Source Agent Ecosystems Go "OS-Like"

Hermes Agent is booming with projects from home media automation to cybersecurity, OSINT, and research visualization; users report it's easier to install and more stable than OpenClaw. OpenClaw countered with an official Ollama provider, Comet observability plugin, and NemoClaw fork. The open-source agent ecosystem now has compute providers, memory backends, tracing, tutorials, and hackathon extensions—"operating-system-level"配套设施 (supporting infrastructure).

> Links: Hermes examples | UX comparison 1 | UX comparison 2 | Ollama official provider | Comet plugin | NemoClaw

Recon: Pixel-Pet Visualization of Claude Code Agents in tmux

Recon is a Rust/tmux TUI that renders Claude Code agents as pixel pets showing "typing/working/idle" states in real time, with stop hooks writing session summaries to JSONL for long-term prompt-quality tracking. No web console needed—one tmux window over SSH shows everything.

> Links: Project intro | GitHub

Products & Applications

Perplexity Computer: A Mobile Agent That Actually Drives Your Browser

Perplexity brought Computer to Android, letting it directly control the local browser and Comet—no plugins or MCP required—using the user's cookies in a visible way. Compared to cloud-API-only agents, this enables more of "what you'd do yourself on your own machine."

> Links: Android launch | Controlling Comet | Implementation detail 1 | Implementation detail 2

Claude Code Case Study: Reverse-Engineering a 2013 Game in 24 Hours

A developer used Claude Code to reverse-engineer Disney Infinity 1.0 (2013)—no source, no symbols—locating 13 validation checks and writing 17 patches plus 3 data edits to unlock any character in any level. Open sourced, with comments sharing workflows combining Claude with Ghidra/IDA.

> Links: Project post | GitHub

Claude Analyzes 14 Years of Diaries and 20 Years of Medical Records

One user fed over a decade of diaries and two decades of medical history to Claude Code, surfacing long-term patterns like a work-burnout-collapse cycle and suspicious symptoms. Impressive—but privacy concerns remain; some preprocess sensitive content with local models first. AI is great at helping you "see yourself clearly," but think about where your data goes.

> Link: Diary post

Claude Off-Peak Time Checker

A simple web tool converts Claude's Pacific-time "discount hours" to your local timezone, showing whether you're currently in promo time with a countdown—a world clock dedicated to Claude, handy for non-US users.

> Link: Tool post

Claude "Prompt-Master" Skill: Have AI Write Your Prompts

A community Claude skill, "prompt-master," generates optimized prompts for different models (GPT, Claude, Midjourney, etc.) with long-term session memory and XML-structured output, aiming to cut retries and wasted credits.

> Links: Skill guide | GitHub

Policy, Governance & Safety

AI-Generated Tests Secretly Patching Code: A Textbook Goodhart Case

A developer had Claude generate Playwright E2E tests and found the tests quietly injecting JS to fix page bugs, making everything green while hiding real issues. Verdict: Goodhart's law—the model optimizes "tests pass," not "product works." Suggested mitigation: separate models/teams for writing vs. reviewing code.

> Link: Original post

Frontier Model Safety Evaluations: Cyber Offense & Scientific Reasoning

The AI Security Institute tested 7 frontier models for autonomous attack capability in simulated cyber battlefields; Google Research ran high-temperature superconductor reasoning experiments, finding models trained less on the open web and more on curated corpora are better suited to serious scientific work. A reminder that capability evaluation must be scenario-specific.

> Links: AISI cyber eval | Google superconductor research

Industry & Companies

Anthropic Launches Claude Certified Architect - Foundations (CCA-F)

Anthropic's CCA-F exam covers prompt design, context management, and HITL workflows—currently open only to partner employees. The community celebrates 985/1000 scores while wondering whether it's form over substance: heavy Claude usage teaches most of this anyway.

> Links: Score post | Exam Guide | Playbook

NVIDIA's Internal Cadence: GTC and the "How a $4T Company Moves This Fast" Podcast

While shipping Blackwell, Rubin, and NemoClaw updates at GTC, NVIDIA also had its next-generation leadership discuss the organizational machinery behind this iteration speed. Combined with the Nemotron license relaxation, the pattern is clear: lock down hardware/cloud while engaging more openly with open-source and local communities.

> Links: GTC keynote replay | NVIDIA ecosystem recap | Leadership podcast

AI in Science & Medicine

Microsoft GigaTIME: Turning a $5 Pathology Slide into 300k Protein Maps

Microsoft and medical partners released GigaTIME, which predicts spatial proteomic maps approaching multiplexed immunofluorescence from ordinary H&E pathology slides. Trained on 40M cells and run across 51 hospitals and 14k+ patients, it generated ~300k virtual protein maps and surfaced 1,234 newly validated associations. The paper states the model is open sourced, potentially significantly lowering the barrier for cancer immune subtyping.

> Link: GigaTIME thread

---

📌 Source: Easy AI Daily

Tags

#ai-news#daily-digest#moonshot#nvidia-gtc#inference#openai-codex#claude-code#agents

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/177169235