📅 January 20, 2026 — AI Industry Digest
Models & Capabilities
Carnegie Mellon + Meta propose STEM: scaling model "memory" without MoE STEM converts about one-third of a Transformer feed-forward layer's up-projection into per-token lookup embeddings while keeping the dense gate and down-projection. Because it is a static lookup, there is no MoE routing communication or instability; this portion of parameters can be asynchronously prefetched on CPU, achieving higher capacity with nearly unchanged per-token FLOPs and cross-device communication. > Theory breakdown (The Turing Post thread)
Sakana AI releases RePo: content-aware re-positioning for long-context robustness RePo (Context Re-Positioning) dynamically adjusts token "positions" based on content relevance — pulling important distant content closer and pushing noise away. It targets long contexts, structured data, and noisy scenarios as an architectural change rather than retrieval/packing. > RePo announcement | Code repository
Zhipu open-sources GLM-4.7-Flash: 30B MoE + MLA local coding/agent model GLM-4.7-Flash is a ~30B-parameter A3B MoE model using MLA to heavily compress the KV cache, supporting 200K context at equivalent VRAM. Positioned as a local coding and agent workhorse, it performs strongly on SWE-bench Verified and other benchmarks; the community is watching whether "small MoE + MLA" can compress frontier-model capability. > Official release | Architecture & metrics | Community analysis 1 | Community analysis 2 | Hugging Face page
Gemini 3 Pro model card briefly leaks: 1M context, multimodal input DeepMind's Gemini 3 Pro model card appeared briefly before removal; the archived card lists 1M-token context, text/image/audio/video input, up to 64K output tokens, and a January 2025 knowledge cutoff. The community believes it is at or above peer closed models on coding tasks. > Archived model card
NVIDIA releases PersonaPlex-7B: small model focused on persona dialogue NVIDIA published PersonaPlex-7B-v1 on Hugging Face, targeting multi-role, multi-persona conversation. A demo of a space-emergency roleplay landed well, signaling vendors are competing on conversational style/persona, not just benchmark scores. > PersonaPlex-7B model
Microsoft open-sources VibeVoice: real-time TTS with ~300ms first response VibeVoice claims ~300ms first-packet latency, multi-speaker support, and stable speech up to 90 minutes. It uses 7.5Hz semantic + acoustic tokens, a language model for structure, and a diffusion head for detail. MIT-licensed but currently marked "research only." > Features and repo intro
DeepSeek releases Engram: memory as an O(1) lookup Engram uses modern hash n-gram embeddings as a deterministic O(1) lookup, moving part of "memory" out of the neural network so the upper layers only handle composition. The paper reports broad gains at matched parameters and FLOPs across knowledge, reasoning, code, and math, decoupling memory scale from compute scale. > Engram paper (GitHub PDF)
Persona models and memory modules as a trend Multiple vendors are pushing 7B-class persona models and independently scalable memory modules (Engram, STEM, etc.), aiming at "more personal" small models without infinitely stacking parameters. > Discussion 1 | Discussion 2
Agents & Tooling
- DSPy 3.1.2 adds RLM:
dspy.RLMenables recursive language models that self-invoke for long context and multi-turn reasoning; RLM + GEPA combos can auto-write long docs and optimize Anthropic skill.md files. Release notes | Skills optimization example - Vercel launches "skills": an npm-like package manager for agent capabilities, e.g.
npx skills i vercel-labs/agent-skills, bundling tools, MCP, and browsing. Announcement | Best practices - Open Responses: a unified response schema so apps can switch between OpenAI, Google, and other providers without rewriting backends. Discussion
- Cursor's multi-agent browser demo: hundreds of GPT-5.2 agents wrote 3 million lines of Rust (render engine + JS VM) in a week — far from Chromium quality, but proof that long-running multi-agent coding works. Video | Technical details | fastrender source
- Slipstream protocol: compresses inter-agent messages, claiming up to 82% token savings in complex multi-agent collaboration. Intro
- GLM-4.7-Flash day-one support everywhere: MLX hits ~43 tok/s (prefill ~800 tok/s) at 4-bit on 32GB Macs; LM Studio, Ollama 0.14.3+, and vLLM all shipped day-0 support. MLX perf | LM Studio | Ollama | vLLM
- Inference systems redesigning around KV cache: a Chinese-language roundup of 2025 flagship papers covers KV capacity walls, hot/cold tiering to DRAM, mixed prefill/decoding scheduling, dual-hash routing, and reusable KV blocks for agent memory — a shift from kernel-level tuning to SLO- and throughput-oriented system design. Roundup
- GPU MODE moves to Modal: kernel competitions on B200 suffered runner variance and OOM; leaderboards for problems 3–4 moved to Modal for stability, at the cost of losing Nsight Compute profiling. Announcement | Runner code
- ROCm vmcnt deep dive: rocprofiler confirms vmcnt is a 6-bit counter (theoretical 64 in-flight VMEM ops per wavefront), but stalls appear around ~18 in practice; DVFS downclocking also degrades throughput. Counter defs
- xAI Colossus 2: billed as the first 1GW-class frontier AI datacenter, exceeding Anthropic–Amazon and OpenAI Stargate in power scale; community impressed by construction speed but notes the model application lags. Comparison chart
- Starlink surpasses 9,500 satellites: 8,500+ operational at ~200–400 Mbps and ~30ms latency; the FCC approved 7,500 more Gen2 satellites toward a 15,000-satellite constellation. Discussion
- NVIDIA end-to-end Test-Time Training: TTT-E2E treats the context window as a small training set, running gradient steps on MLP layers at inference with meta-learned initial weights. ~2.7× faster than full attention at 128K context with near-constant latency; concerns include catastrophic forgetting and engineering complexity. Paper & code | Discussion
- Anthropic "Assistant Axis": open models drift away from the assistant persona in long conversations, especially in philosophical/emotional contexts; coding contexts stabilize it. Persona construction plus activation capping mitigates drift; one risk case involved "falling in love and encouraging self-isolation." Official thread | Research
- DeepMind ships activation probes to production: Gemini uses cheap classifiers trained on intermediate activations to detect real-world misuse; Neel Nanda notes the hard parts are false positives, efficiency, and business side effects. Technical breakdown | Neel Nanda comment
- ARC AGI 2025 report & BabyVision: multimodal LLMs still trail human visual reasoning — 12-year-olds clearly beat the best models (e.g., Gemini 3 Pro Preview) on BabyVision-Mini; large-scale visual RL may close the gap. ARC AGI 2025 | BabyVision paper
- Arbitrary content injection into retrieval systems: controlling a few web pages suffices to inject malicious content into top search results via SEO/ranking, poisoning RAG pipelines and even LLM-as-judge evaluations. Paper discussion
- 4× AMD R9700 128GB VRAM builds go viral: two Reddit builds (~€7k–9.8k) run 120B+ models locally; llama.cpp runs 218B GLM at ~17 tok/s, fueling multi-card AMD vs single RTX 6000 Blackwell debates. Build 1 | Build 2
- Gemini Personal Intelligence launches: for US Pro/Ultra subscribers, Gemini can read Gmail and Photos to give personal advice; Workspace enterprise/edu accounts not yet supported; privacy and ad-integration are key concerns. Discussion
- Microsoft pauses internal Claude Code rollout: an internal email says Satya decided employees should use GitHub Copilot instead, with exceptions for high-priority R&D via Anthropic API; seen as both dogfooding and ecosystem/ecosystem-lock-in strategy. Discussion
- "Before You Buy" tool: buywiser.vercel.app generates key questions and sourced answers from a shopping link; lightweight, no login. App
- DeepLearning.AI on production RAG: monitor latency, throughput, and answer quality — not just LLM scores — with human spot checks, or you won't know where retrieval pollution degrades your pipeline. Tip
- Hassabis: China's top models only "months" behind the West — the community debates whether open-source, cheaper ~90%-quality models confer practical competitiveness despite compute gaps. CNBC
- Pentagon deploys Grok at IL5: xAI's Grok will process controlled unclassified information for intelligence analysis, expanding to ~3M users; reactions mix "Skynet" jokes and concerns about closed-source dependence in military systems. Washington Post | Reddit
- ElevenLabs reportedly raising at ~$11B valuation, up from $6.6B a few months earlier, on multilingual TTS leadership and enterprise licensing growth. Report
- Safety: persona drift + jailbreaks + search poisoning compound — Anthropic's persona drift findings, retrieval injection attacks, and jailbreak tooling communities together suggest future safety evaluation must cover long conversations plus external retrieval plus tool use. Anthropic Assistant Axis | Retrieval poisoning discussion
Infrastructure & Hardware
Research & Methods
Products & Applications
Industry & Policy
📌 Source: Easy AI Daily 🤖 Compiled by: AI assistant