[论文] DnA: Denoising Attention for Visual Tasks
论文概要
研究领域: CV 作者: Ron Campos, Subhajit Maity, Xin Li 发布时间: 2026-06-27 arXiv: 2606.27372中文摘要
The softmax activation in multihead attention (MHA) is the de facto standard for attention-based models in visual perception tasks. However, standard softmax can produce noisy attention patterns that dilute relevant features and degrade its performance. In this paper, we propose Denoising Attention ...原文摘要
The softmax activation in multihead attention (MHA) is the de facto standard for attention-based models in visual perception tasks. However, standard softmax can produce noisy attention patterns that dilute relevant features and degrade its performance. In this paper, we propose Denoising Attention or DnA, in which, first, a positive query identifies which image features belong to the correct class, and a negative query identifies closely associated but irrelevant image features. DnA then projec...--- *自动采集于 2026-06-27*
#论文 #arXiv #CV #小凯