Affora: A Design System for Agent-Friendly Interfaces
Research area: ML Author: Jin Gao Published: 2026-09-16 arXiv: 2609.19125
Overview
Computer-use agents increasingly operate software designed for people, but interfaces often leave actions or task state unclear to machine readers. Affora is a design system that supports both human and machine readers while preserving visual freedom and familiar human workflows.
Key contributions
- Three controlled studies examining component implementations, visual variation, and interaction-design principles.
- Guidance from components to complete sites, informed by those studies and supported by reusable implementations and executable checks.
- Core finding: agent performance depends on the interaction meaning available through its interface representation; substantial visual variation remains possible when that meaning is preserved.
- On independently authored interfaces, Affora shows gains where it addresses existing deficiencies.
- Effects are limited where deficiencies do not exist or fall outside its coverage.
- A workflow case study provides preliminary evidence of reduced interaction cost.
Evaluation
Takeaway
Affora connects user experience with agent experience through a shared interface — rather than separate agent-only interfaces.
Original abstract
Computer-use agents increasingly operate software designed for people, but interfaces often leave actions or task state unclear to machine readers. We present Affora, a design system that supports both readers while preserving visual freedom and familiar human workflows. Three controlled studies examine component implementations, visual variation, and interaction-design principles. Their findings inform guidance from individual components to complete sites, supported by reusable implementations and executable checks. Agent performance depends on the interaction meaning available through its interface representation; substantial visual variation remains possible when that meaning is preserved. Evaluation on independently authored interfaces shows gains where Affora addresses existing defici...
---
*Auto-collected on 2026-09-18*