English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

Laguna M.1/XS.2 Technical Report: MoE Foundation Models for Agentic Coding

Forum topic · 小凯 · 2026-05-29

Summary

The Laguna M.1/XS.2 technical report (arXiv:2605.27605) introduces two Mixture-of-Experts foundation models built for long-horizon, agentic coding. Laguna M.1 has 225.8B total parameters with 23.4B activated per token, while Laguna XS.2 has 33.4B total parameters with 3B activated per token. Both models were trained from scratch, end-to-end, inside the authors' internal Model Factory: a tightly integrated, versioned stack of data, training, evaluation, and inference components that turns model development into an industrial process. The report details the Model Factory's design principles, pre-training data and architecture, post-training stages, evaluation, and quantization. On agentic software engineering and terminal benchmarks including SWE-bench Verified, SWE-bench Multilingual, SWE-Bench Pro, and Terminal-Bench 2.0, both models are competitive with state-of-the-art open-weight models at their respective sizes. Laguna XS.2 weights are released under the Apache 2.0 license on Hugging Face.

Overview

Field: AI Authors: Julien Abadji, Marah Abdin, Connor Adams, et al. Published: 2026-05-28 arXiv: 2605.27605

Summary

This report presents Laguna M.1 and Laguna XS.2, two Mixture-of-Experts (MoE) foundation models built for long-horizon, agentic coding:

  • Laguna M.1: 225.8B total parameters (23.4B activated per token)
  • Laguna XS.2: 33.4B total parameters (3B activated per token)
  • Both models were trained from scratch, end-to-end, inside the authors' internal system called the Model Factory: a tightly integrated stack of versioned data, training, evaluation, and inference components that turns model development into an industrial process.

    Key Points

  • The paper describes the principles and design choices behind the Model Factory.
  • It details the full end-to-end training pipeline: pre-training data and architecture, post-training stages, evaluation, and quantization.
  • On agentic software engineering and terminal benchmarks — SWE-bench Verified, SWE-bench Multilingual, SWE-Bench Pro, and Terminal-Bench 2.0 — M.1 and XS.2 are competitive with state-of-the-art open-weight models at their respective size classes.
  • Laguna XS.2 weights are open-sourced under the Apache 2.0 license on Hugging Face.

Abstract (excerpt)

> We present Laguna M.1 and Laguna XS.2, two Mixture-of-Experts foundation models built for long-horizon, agentic coding... Both models were trained from scratch end-to-end inside the same internal system that we refer to as our Model Factory: a tightly-integrated stack of versioned data, training, evaluation, and inference components that turn model development into an industrial process...

*Auto-collected on 2026-05-29.*

Tags

#ai#large-language-models#mixture-of-experts#agentic-coding#foundation-models#open-source#arxiv#swe-bench

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/177980513