English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

SCORE: Label-Free Cross-Subject EEG-to-Image Retrieval via Subject Coordinate Recovery

Forum topic · 小凯 · 2026-08-21

Summary

SCORE (Subject Coordinate Recovery) is a target label-free framework for EEG-to-image retrieval that addresses the performance drop seen with new users lacking labeled calibration. Analyzing cross-subject EEG features, the authors found that different subjects preserve similar relationships among concepts but express them along different coordinate directions. SCORE combines recovery-aware source training with coordinate alignment at deployment: during training, source-subject EEG is aligned to a shared image space while simulating unseen-subject recovery using only source segments; at deployment, both encoders are frozen, reliable EEG-image landmarks are selected via hubness-corrected matching, and an orthogonal transformation is estimated to recover the target subject's coordinates—requiring no source data or target labels. On 200-way retrieval across two public benchmarks, SCORE outperforms unadapted baselines for every target subject, achieving 53.23%/83.55% Top-1/Top-5 on THINGS-EEG2 and 12.01%/32.16% on Alljoined-1.6M, surpassing the strongest baselines by 17.45/15.70 and 3.08/4.62 percentage points respectively.

Paper Overview

Field: Machine Learning Authors: Zhenyao Cui, Siyuan Kan, Siyang Li, Ziwei Wang, Dongrui Wu Published: 2026-08-19 arXiv: 2608.19134

Abstract

Accurate visual decoding can reveal how the brain represents visual information and recover perceived content from neural signals such as electroencephalography (EEG), with potential for neural communication. However, current EEG-to-image retrieval methods perform far below their within-subject counterparts for new users without labeled calibration, limiting real-world deployment.

To understand this gap, the authors analyze EEG features across subjects and find that different subjects preserve similar relationships among concepts but express them along different coordinate directions. They therefore propose SCORE (Subject Coordinate Recovery), a target label-free framework combining recovery-aware source training with coordinate alignment at deployment.

  • During training: SCORE aligns source-subject EEG to a common image space and simulates unseen-subject recovery using only source segments.
  • At deployment: Both encoders are frozen. SCORE selects reliable EEG-image landmarks via hubness-corrected matching and estimates an orthogonal transformation to recover the target subject's EEG coordinates—without needing source data or target labels.

Results

On 200-way retrieval over two public benchmarks, SCORE outperforms unadapted baselines for every target subject and achieves the best overall accuracy:

| Benchmark | Top-1 | Top-5 | Gain over strongest baseline | |---|---|---|---| | THINGS-EEG2 | 53.23% | 83.55% | +17.45 / +15.70 pp | | Alljoined-1.6M | 12.01% | 32.16% | +3.08 / +4.62 pp |

Without target labels or encoder updates, SCORE brings brain-based visual decoding closer to robust, practical, low-latency deployment across users.

Link: https://arxiv.org/abs/2608.19134

Tags

#eeg#brain-computer-interface#image-retrieval#cross-subject#deep-learning#computer-vision#neuroscience#arxiv

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178633746