Paper Overview
- Field: Machine Learning
- Authors: Mansoor Ahmed, Sujin Lee, Umar Khayaz
- Published: 2025-05-20
- arXiv: 2505.15985
- Progressive PLM unfreezing
- R-Drop consistency regularization
- +16% sequence recovery over the best GNN baseline
- 43% lower perplexity
- 2.3x higher amino acid diversity restored
- Highest binding-pair correlation with ground truth
Problem
Equivariant graph neural network (GNN) methods for antibody complementarity-determining region (CDR) design achieve the highest sequence recovery but suffer from severe vocabulary collapse: the best GNN methods over-predict a small set of amino acids (e.g., tyrosine and glycine) while ignoring functionally important residues. The authors trace this failure to GNN encoders learning amino acid distributions de novo from limited structural data, discarding substitution patterns encoded in evolutionary databases.
Method
EvoStruct bridges a frozen protein language model (PLM) with 3D structural context from an E(3)-equivariant GNN via a cross-attention adapter. Unlike prior PLM-structure adapters built for general protein design, EvoStruct specifically targets vocabulary collapse in CDR design through:
Results
On CHIMERA-Bench, EvoStruct achieves the highest amino acid recovery and lowest perplexity across antibody design methods:
Original Abstract
Equivariant graph neural network (GNN) methods for antibody complementarity-determining region (CDR) design achieve the highest sequence recovery but suffer from severe vocabulary collapse. The current best GNN methods over-predict very few amino acids, such as tyrosine and glycine, while ignoring functionally important residues. We trace this failure to GNN encoders learning amino acid distributions de novo from limited structural data, discarding substitution patterns encoded in evolutionary databases. To resolve this, we propose EvoStruct, which bridges a frozen protein language model (PLM) with 3D structural context from an E(3)-equivariant GNN via a cross-attention adapter. Unlike prior PLM-structure adapters for general protein design, EvoStruct targets the vocabulary collapse proble... *(truncated)*
---
*Auto-collected on 2026-05-22.*