Key points
Models & Capabilities
- DeepSeek MHC: New paper on Manifold-Constrained Hyper-Connections uses constrained matrices to fix signal amplification and gradient explosion in 27B-scale hyper-connected models. Rumors (Reuters, The Information) suggest DeepSeek V4 launches in February with a focus on long-code understanding/generation.
- Falcon-H1R-7B: TII's 7B open reasoning model performs well on Humanity's Last Exam, τ²-Bench Telecom, and IFBench; attribution-required licensing dents its openness score.
- FineTranslations: Gemma3-27B used to translate FineWeb2 into English, producing a 1T+ token parallel corpus for multilingual alignment, distillation, and RAG.
- LTX-2: Open-source audio+video generation model running on <8GB VRAM, generating ~20s video in ~5 minutes on an RTX 4090, with LoRA training code.
- LFM 2.5: 2.5B model rivals much larger Qwen3 models for synthetic training data generation; LFM2.5-1.2B-Instruct-SDG runs on ~1GB VRAM.
- MCP ecosystem: OpenAI shipped an official MCP server; community mcp-cli replaces verbose tool descriptions with discovery (claimed 99% token savings); spec implementation issues appear on GitHub.
- Agent Skills standardize: Anthropic's skill.md pattern (Markdown + scripts loaded on demand) is echoed by GitHub Copilot, Claude Code 2.1 (recursive skill forks), VS Code, and Cline.
- AI21 MCP Workspace: git-worktree-based transactional workspaces let up to 16 concurrent agent attempts run independently, then merge the winner.
- InfiAgent: file-based state management plus fixed recent-interaction windows frames long-horizon agents as a context engineering problem.
- OpenRouter: new "partition" routing sets performance floors without added latency; Skills Loader SDK wraps Anthropic-style skills for any model.
- Claude Code code-simplifier: open-sourced, but early users report it sometimes deletes important code—guardrails still needed.
- Compute growth: Epoch AI estimates global AI compute doubles every ~7 months; NVIDIA accounts for 60%+ of new capacity; Anthropic's Indiana datacenter estimated at ~750MW, nearing 1GW.
- Modal: operating 20,000+ concurrent GPUs across clouds makes health checks, redundancy, and scheduling first-class concerns.
- torch 2.9: fixes flash_attn_varlen + torch.compile graph breaks, yielding ~50% throughput gains in community tests.
- AMD GPUs: 7900XTX raw compute nears a 4090 but CUDA ecosystem remains ~10% faster; ROCm toolchain friction persists.
- GPU shopping: 75W cards (T4/A2000) for low-power builds; RTX 5090's 400W minimum VBIOS power makes it a poor quiet workstation choice.
- GDPO: per-reward normalization fixes GRPO's advantage collapse in multi-reward RL settings.
- LM Jigsaw: VLMs solve 3×3 jigsaws at ~95% but fail almost completely at 5×5 (token cost rising from ~55k to ~345k), suggesting patch matching rather than global spatial reasoning.
- CGGR: skipping gradients on some steps reportedly saves up to 75% training memory (preliminary, Eleuther community experiments).
- "Dead Salmon": interpretability methods (probes, SAEs, attribution) produce plausible-sounding explanations even for randomly initialized networks (arXiv:2512.18792).
- MHC discussion: community consensus frames structural constraints—not ever-wider stacking—as the path to scaling deep networks.
- OpenAI for Healthcare: HIPAA-compliant offering live at AdventHealth, UCSF, Memorial Sloan Kettering.
- Claude Code as full-stack partner: engineers ship weekend POCs beyond their specialties; humans still own architecture simplification.
- Lovable: system prompt optimization cut costs enough to save ~$20M/year in LLM spend while improving output quality.
- Anthropic tightens Claude Max: third-party client access restricted, pushing developers toward BYO-key and multi-provider wrappers.
- MiniMax IPOs in Hong Kong, positioning itself as an open multimodal ecosystem.
- LMArena stats: #1-ranked models hold the top spot for only ~35 days on average; most fall out of the top five within five months.
- ChatGPT zero-click vulnerability: Radware reports a server-side flaw triggered by a crafted email with no user interaction; disclosed to OpenAI.
- Billing disputes: complaints about auto-upgrades from Plus to Pro and opaque Claude Code usage accounting erode trust.
- NO FAKES Act: proposed fingerprinting mandates could effectively ban public voice cloning, sparking debate.
- Anthropic agent evals guide: build regression and capability evals from real production failure traces; pass@k vs pass^k metrics highlighted.