AI Research Enters the Agentic Workflow Era: From Alchemy to Agent Workflows
This post discusses a paradigm shift in AI research: moving away from单纯 scaling model parameters (the "alchemy" era) toward sophisticated agentic workflows and systems engineering, illustrated by two systems: AutoResearchClaw and Omni-SimpleMem.
AutoResearchClaw: A Closed-Loop Autonomous Research Agent
AutoResearchClaw is a fully autonomous AI research system requiring no human intervention. Within 72 hours, it independently completed 50 complex experiments, automatically fixed code bugs, and wrote a rigorous academic paper. Its architecture is a 23-stage autonomous research pipeline that converts a research idea into a complete conference paper, covering:
- Problem definition
- Literature discovery and filtering
- Experimental design
- Code generation and execution
- Result analysis
- Paper writing and quality review
- Vision: CLIP-based scene similarity detects scene changes; new images are stored only on significant changes, reducing visual storage by ~70%.
- Audio: Voice activity detection (VAD) filters silence/noise.
- Text: Jaccard similarity deduplicates redundant sentences.
- Hot storage (in-memory): lightweight metadata summaries — abstracts, vector embeddings, timestamps, modality types, and pointers to raw data.
- Cold storage (disk/cloud): raw multimodal data (HD images, long audio, video), loaded on demand.
Throughout the run, the system uses multi-agent debate to refine ideas and self-diagnosis and repair to overcome technical obstacles — a full end-to-end research loop where AI becomes the "driver" rather than a passive "engine."
Omni-SimpleMem: Lifelong Multimodal Memory
Omni-SimpleMem addresses how a lifelong AI agent can accumulate and retrieve multimodal experience efficiently.
Selective Ingestion ("Decluttering")
Only genuinely novel, valuable information is stored. Lightweight perceptual encoders measure the information entropy/novelty of each input:
Hot/Cold Data Separation
A two-tier storage architecture:
Retrieval: Hybrid Search Without LLM Re-Ranking
The agent autonomously discovered that merging dense vector retrieval (FAISS) and sparse keyword retrieval (BM25) via union outperforms LLM-based re-ranking — improving both recall and efficiency while avoiding extra cost and instability.
Pyramid Progressive Retrieval
Under a strict token budget, retrieval proceeds in three layers:
1. Preview: ~10-token summaries of many memory units (broad clues). 2. Details: full text and metadata of relevant units (richer context). 3. Evidence: original media loaded from cold storage as needed (fewest items, most direct evidence).
This balances recall and precision, like a detective gathering clues, then details, then decisive evidence.
Knowledge Graph for Multi-Hop Reasoning
The system builds a knowledge graph with 7 entity types and 12 relation types linking memories across modalities and time. Given a query, the agent identifies seed entities, expands several hops (h-hop) through the graph, and applies distance-decay scoring to chain cross-time, cross-modal information into a reasoning path — enabling answers to complex questions that span multiple experiences.
The Paradigm Shift: Systems Engineering Beats Scale
The most striking finding: AutoResearchClaw's biggest performance gains came not from hyperparameter tuning but from system-level improvements:
| Optimization type | Performance gain | |---|---| | Bug fixes | ~175% | | Architecture changes | ~44% | | Prompt optimization (specific category) | ~188% | | Hyperparameter tuning (cumulative) | less than any of the above (~40%) |
This suggests that in complex AI systems, code quality, architecture design, and human-AI interaction matter more than marginal model scaling. The trend mirrors moves by major labs (e.g., OpenAI's emphasis on tool use, multi-step planning, and long-term memory; Google's PaLM-E; DeepMind's Gato) toward embedding models in autonomous, end-to-end workflows. The agentic workflow era — with memory, retrieval, planning, and collaboration — is emerging as AI's next frontier.