English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

NVIDIA ASPIRE: A Self-Improving Robotics Framework That Puts Claude Code in the Embodied Loop

Forum topic · 小凯 · 2026-07-05

Summary

NVIDIA, with the University of Michigan, UIUC, UC Berkeley, and CMU, introduced ASPIRE (Agentic Skill Programming via Iterative Robotics Exploration), a continuous-learning framework where robots write, debug, and improve their own code-as-policy programs. ASPIRE combines a coordinator-executor multi-agent architecture, a closed-loop execution engine that logs every perception/planning/control call with multimodal traces for root-cause failure diagnosis, a heterogeneous skill library of distilled fixes, and evolutionary search over K candidate programs. Using Claude Code with Claude Opus 4.6 (1M token context) and CaP-X on MuJoCo Playground, ASPIRE outperforms the strongest baseline by +77 points on LIBERO-Pro Object, lifts a bimanual handover task from 20% to 92%, and raises zero-shot transfer on LIBERO-Pro Long from ~4% to ~31%. On real robots using OpenAI Codex GPT-5.5 as the coding agent, simulation-trained skills transfer across embodiments: can picking improves from 13/20 to 19/20 with 10x fewer tokens, and drawer opening from 0/20 to 11/20. The post analyzes why this marks the first engineering demonstration of cross-task experience transfer in embodied AI, while cautioning that 31% zero-shot remains low, real-robot validation covers only a few tasks, and inference costs may challenge commercial ROI.

NVIDIA ASPIRE: A Self-Improving Robotics Framework That Puts Claude Code in the Embodied Loop

Published: 2026-07-04 14:32 (Beijing Time) Source: MarkTechPost Original article: https://www.marktechpost.com/2026/07/03/nvidia-ai-introduces-aspire-a-self-improving-robotics-framework-reaching-31-zero-shot-on-libero-pro-long-tasks

What Happened

On July 3, NVIDIA together with the University of Michigan, UIUC, UC Berkeley, and CMU proposed ASPIRE (Agentic Skill Programming via Iterative Robotics Exploration), a continuous-learning framework that lets robots write code and self-improve.

The core mechanism has four components:

  • Coordinator-executor architecture: A central coordinator manages the skill library and dispatches coding executor agents to different tasks. Executors do not exchange conversation histories with each other — they only pass along "distilled skills."
  • Closed-loop execution engine: Every perception/planning/control call stores inputs, outputs, RGB keyframes, grasp candidates, and object poses. The agent only inspects calls related to the failure, pinpoints the root cause, and validates the fix.
  • Skill library: Stores heterogeneous repair solutions — localization heuristics, perception prompts, grasp constraints, motion primitives, debugging workflows. Not entire task programs.
  • Evolutionary search: Each round proposes K candidate programs; the next round explores different strategies rather than refining a single solution, avoiding local-fix death loops.
  • Experiments were run with Claude Code + Claude Opus 4.6 (1M token context), with programs written in CaP-X (an open-source code-as-policy framework built on MuJoCo Playground).

    Results:

  • LIBERO-Pro Object suite: +77 points over the strongest baseline; Goal +41.5 / Spatial +42.5
  • Robosuite bimanual handover: 20% → 92%
  • BEHAVIOR-1K radio pickup: 56% → 88%
  • Zero-shot transfer (reusing skills accumulated on LIBERO-90): LIBERO-Pro Long from ~4% → ~31%
  • Real-robot experiments used OpenAI Codex GPT-5.5 as the coding agent — skills trained in simulation transfer across embodiments. Can picking: 13/20 → 19/20 with 10x fewer tokens; drawer opening: 0/20 → 11/20.

    Deep Analysis

    ASPIRE pushes robot programming from "single attempts" toward "continuous learning." The key is not the numbers but three things:

    1. Failure diagnosis is pushed down from "scene-level" to "primitive-level." Previous code-as-policy agents treated failures as "task failed, try again." ASPIRE stores multimodal trajectories for every perception/planning call, so the agent can precisely locate root causes like "the target position is inside cuRobo's collision buffer" and write a repair strategy. This is the same idea as breaking a coarse "overall failure" signal into fine-grained ones.

    2. The skill library is not a "prompt list" — it's a "collection of heterogeneous repair solutions." It contains localization heuristics, grasp constraints, motion primitives, and debugging workflows, with each skill annotated with "failure signature + applicability conditions + repair strategy + code sketch." This is the engineering form of the idea that agents should autonomously decide tests and model selection — the skill library = the agent's muscle memory.

    3. Claude Code with 1M context runs in simulation, and evolutionary search lets K candidates explore in parallel. This is the core gap versus prior work like CaP-Agent0: CaP-Agent0 discards experience after each task, while ASPIRE distills validated fixes into the skill library for direct reuse next time.

    Zero-shot LIBERO-Pro Long going from 4% to 31% — a 7.75x improvement — is the first engineering demonstration of "cross-task experience transfer" for embodied intelligence.

    Why It Matters

    1. The embodied "reinforcement learning loop" runs with code as policy for the first time. Where VLA (vision-language-action) models rely on a data flywheel (π0, OpenVLA), ASPIRE uses a code-execute-distill flywheel — no new data needed, only new attempts. 2. Real-robot cross-embodiment transfer, empirically shown. Can picking uses 10x fewer tokens; drawer opening goes from 0/20 to 11/20. Simulation-trained skills port to different morphologies — an engineering answer to the "data reuse" problem that embodied AI companies lack most. 3. Claude Code + 1M context is ASPIRE's compute anchor. This is no coincidence — pairing Claude Code + Opus 4.6 1M context for embodied labs fits the broader pattern of model-provider × physical-deployment bundling. 4. AI coding paradigm feeding back into embodied AI. The notion of a "Harness era," ForgeTrain's "AI writing its own training framework," and ASPIRE's "AI writing its own robot programs" all point one way: the AI coding capability flywheel is now supplying embodied intelligence.

    Risks and Open Questions

  • 31% zero-shot is still low. LIBERO-Pro Long is a newly introduced benchmark; 4% → 31% looks dramatic, but 31% remains insufficient for industrial settings.
  • Only 3 real-robot tasks were tested. Can picking, drawer opening, and one unlisted task — the sample is too small; transfer reliability needs more real-task validation.
  • Code-as-policy ≠ end-to-end VLA. ASPIRE blocks the agent from reading physics engine state and .bddl/.xml/.urdf files in simulation — hard constraints to maintain in production. If the real world presents unknown topology (e.g., novel objects), can code-as-policy still self-repair?
  • Training cost is undisclosed. 1M context + evolutionary search over K candidates + the closed-loop execution engine sounds inference-expensive. If each bug fix costs tens of dollars in tokens, the skill library's ROI becomes the key commercialization question.
Bottom line: ASPIRE turns "robot programming" from one-off scripts into "a developer that accumulates its own experience" — the first engineering-meaningful "cross-task learning" in embodied intelligence, worth every embodied-AI team benchmarking against on LIBERO-Pro.

Tags

#nvidia#aspire#robotics#embodied-ai#claude-code#code-as-policy#continual-learning#zero-shot-transfer

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178208439