[论文] Reasoning and Planning with Dynamically Changing Norms

论文概要

研究领域: AI
作者: Taylor Olson, Roberto Salas-Damian, Kenneth D. Forbus
发布时间: 2026-05-28
arXiv: 2605.27622

中文摘要

为安全地与人类交互,AI智能体必须了解人类规范并在规划时加以考虑。然而,规范引导的规划研究较少,且仅限于人工智能体社群,忽略了规范的动态性。本文提出了一种在人机交互场景中利用动态变化规范引导规划的方法。贡献包括:一个用于解决规范冲突的可废止演算,以及将动态规范作为规划护栏的方法。作者通过形式化证明从理论上论证了方法,并通过AI智能体SocialBot在自然语言对话任务上进行了实证验证。

原文摘要

To safely interact with humans, AI agents must both know our norms and consider them during planning. However, such norm-guided planning has been less explored, only within communities of artificial agents, and has ignored the dynamic nature of norms. This paper instead presents an approach to guiding planning with dynamically changing norms in a human-AI setting. We contribute a defeasible calculus for resolving normative conflicts and an approach to using such dynamically changing norms as guard rails on plans. We theoretically demonstrate our approach with formal proofs and empirically with an AI agent, SocialBot, on a natural language dialogue task.

自动采集于 2026-05-29

#论文 #arXiv #AI #小凯