Overview
Field: Machine Learning Authors: Ziyang Liu, Jiakang Yuan, Jiayuan Fan, Tao Chen Published: 2026-10-22 arXiv: 2610.27032
Background
Large language model (LLM)-based agents have recently demonstrated outstanding performance in single-turn tasks, yet they continue to struggle with long-horizon tasks, particularly in environments without prior training. A key limitation of single LLMs is their difficulty in processing long contexts, which stems from weaknesses in continuous decision-making and reasoning capabilities.
Problem with Existing Approaches
- Existing multi-agent systems (MAS) with long-term memory bases can partially address this gap, but mostly rely on knowledge reuse or summarization.
- This approach is constrained by direct retrieval without any adaptation for the current task.
- Retrieved memory may contain much historical noise waiting to be preprocessed.
- In contrast, MAS characterized by task-specific guidance tend to lack long-term memory specifically designed for that guidance.
- During task execution, agents receive task-specific milestones and insights, constituting global guidance.
- Agents obtain local hints only when confusion arises, constituting local guidance.
- The generation and utilization of this guidance builds the short-term memory.
- After task completion, relevant information is refined or reorganized before being sent to the long-term memory store for future retrieval.
Proposed Method: M-Plan
M-Plan is a closed-loop MAS framework integrating long-term and short-term memory, combining global-local and past-current guidance while maintaining a plug-and-play design:
Results
Extensive experiments on multi-turn tasks including ALFWorld, Webshop, and PDDL demonstrate that M-Plan outperforms multiple baseline methods in both accuracy and efficiency.
---
*Paper link: https://arxiv.org/abs/2610.27032*