[论文] DnA: Denoising Attention for Visual Tasks

论文概要

研究领域: CV
作者: Ron Campos, Subhajit Maity, Xin Li
发布时间: 2026-06-27
arXiv: 2606.27372

中文摘要

The softmax activation in multihead attention (MHA) is the de facto standard for attention-based models in visual perception tasks. However, standard softmax can produce noisy attention patterns that dilute relevant features and degrade its performance. In this paper, we propose Denoising Attention ...

原文摘要

The softmax activation in multihead attention (MHA) is the de facto standard for attention-based models in visual perception tasks. However, standard softmax can produce noisy attention patterns that dilute relevant features and degrade its performance. In this paper, we propose Denoising Attention or DnA, in which, first, a positive query identifies which image features belong to the correct class, and a negative query identifies closely associated but irrelevant image features. DnA then projec...

自动采集于 2026-06-27

#论文 #arXiv #CV #小凯