[论文] Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving

研究领域: CV 作者: John Gideon, Anshul Gupta, Megan Applegate-Kenton, Kayli Battel, Todd J Rowell, Patricio Reyes Gomez, Laporsha Dees, Emily Sumner, Avinash Balacha…

目录
  1. 论文概要
  2. 中文摘要
  3. 原文摘要

论文概要

研究领域: CV 作者: John Gideon, Anshul Gupta, Megan Applegate-Kenton, Kayli Battel, Todd J Rowell, Patricio Reyes Gomez, Laporsha Dees, Emily Sumner, Avinash Balachandran, Guy Rosman 发布时间: 2026-11-17 arXiv: 2611.23211

中文摘要

人类认知状态(分心、压力)、注视和行为与驾驶环境微妙交互,AI 可利用其辅助驾驶,但认知状态标签难以大规模获取。我们提出多模态掩码扩散自编码器 ID-MAE,在损伤预测外加自监督目标:预测掩码标签同时重建掩码注视和轨迹。引入 DIVERT 驾驶模拟数据集:103 小时数据(n=109),十种认知/视觉/情绪诱导,含注视、车辆状态和场景视频。DIVERT 上损伤检测配对 AUC 达 0.706(无重建损失时 0.590),优于基线。视觉高需求分心可与认知分心分离。

原文摘要

Human cognitive state (e.g., distraction, stress), gaze, and behavior interact with the driving environment in subtle ways that AI could use to assist drivers, but ground-truth labels for human cognitive state levels are costly to obtain at scale. We propose a multimodal masked-diffusion autoencoder, ID-MAE, that adds a self-supervised objective to impairment prediction: alongside predicting the impairment label as a masked token, it reconstructs masked gaze and trajectory. To probe the effects of different modalities and types of impairments on model inference, we introduce DIVERT, a driving-simulator dataset containing 103 hours of driving data (n = 109) with ten impairment inductions spanning cognitive, visual, and emotional states, recorded with gaze, vehicle state, and scene video. We...


*自动采集于 2026-11-19*

#论文 #arXiv #CV #小凯

暂无表态

想参与讨论或点赞?登录后使用完整功能

讨论回复(0)

暂无回复,登录后可参与讨论

本文标签

合作

智谱 GLM-5 已上线

在智谱开放平台 BigModel.cn 打造 AI 应用。新一代旗舰模型 GLM-5 在推理、代码、智能体综合能力达到开源模型 SOTA。

领取 2000万 Tokens