English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

LLM-Assisted Issue-Commit Linking: Turning AI into a Code Archaeologist

Forum topic · 小凯 · 2026-05-04

Summary

This post discusses a research paper, "Think Harder and Don't Overlook Your Options: Revisiting Issue-Commit Linking with LLM-Assisted Retrieval" (arXiv:2605.00447) by Cole Morgan, Muhammad Asaduzzaman, Shaiful Chowdhurry, and Shaowei Wang. Issue-commit linking—identifying which code commit fixes which bug report—is a classic traceability problem, but traditional heuristic methods (keyword matching, temporal proximity) suffer from low precision and recall, especially in large repositories with tens of thousands of issues and commits and no explicit links. The paper proposes an LLM-assisted pipeline with three key ideas: multi-signal retrieval combining textual similarity, code-diff semantics, temporal proximity, developer association, and file-path matching; LLM-based re-ranking that understands deep semantic connections between issue descriptions and code changes; and deliberately considering a wider candidate pool so the LLM can "rediscover" correct commits overlooked by top-k heuristics, plus chain-of-thought reasoning to reason about whether a change truly addresses the issue. The post explains why semantic and code-level understanding beats surface keyword matching, and frames LLMs as "code archaeologists" that recover the intent and history behind changes.

> Paper: Think Harder and Don't Overlook Your Options: Revisiting Issue-Commit Linking with LLM-Assisted Retrieval > Authors: Cole Morgan, Muhammad Asaduzzaman, Shaiful Chowdhurry, Shaowei Wang > arXiv: 2605.00447 | 2026-04-29

The "Who Fixed This Bug?" Problem

Imagine you are a new developer on a project. You see an issue: "The login page crashes on certain browsers." You want to know: has it been fixed? Which commit fixed it? How?

But the repository contains 10,000+ issues and 50,000+ commits with no explicit issue-commit links. Finding the answer manually is like searching for a needle in a haystack.

Why Issue-Commit Linking Matters

  • Software traceability: requirements → design → code → tests, forming a complete development chain for auditing and maintenance.
  • Understanding change motivation: why was this code changed, and for which issue or bug?
  • Knowledge transfer: newcomers quickly learn that "this odd design exists to fix that problem," reducing duplicated work.
  • Limitations of existing methods:

  • Heuristics (keyword matching, temporal proximity): low precision and even lower recall.
  • Deep learning approaches: require large labeled datasets.
  • LLM-Assisted Retrieval: The Paper's Approach

    Core insight: LLMs understand both natural-language semantics and code semantics — a dual understanding that makes them strong at issue-commit linking.

    1. Multi-signal retrieval — beyond text similarity, the approach uses code-change semantics (the diff), temporal proximity, developer association, and file-path matching.

    2. LLM re-ranking — traditional retrieval first produces candidate commits; an LLM then performs fine-grained re-ranking by understanding the deeper connection between the issue description and the code change.

    3. Don't Overlook Your Options — the paper's title: correct commits are often ranked low by traditional methods. Using a wider candidate pool lets the LLM "rediscover" neglected options.

    4. Think Harder — the LLM applies chain-of-thought reasoning: "This issue describes X... this commit changes Y... are they related, and why?" Deep reasoning beats shallow matching.

    Like an experienced code archaeologist, the model looks beyond surface keywords to understand the nature of the problem and the intent of the change.

    Why LLMs Beat Traditional Methods

    Keyword matching fails: an issue says "login crash"; the commit says "fix authentication flow." Keywords don't overlap, but the semantics do.

    Temporal proximity is fragile: fixes may be split across multiple commits or delayed, so proximity assumptions break down.

    LLM strengths:

  • Semantic understanding: linking "login crash" to "authentication flow" despite different vocabulary.
  • Code understanding: reading diffs to infer what problem a change solves and matching it to the issue.
  • Multi-step reasoning: "the issue is about X; the commit modifies Y; Y is part of X; therefore they are related."

Takeaway

> Finding a commit that shares keywords is not the same as finding the commit that fixes the problem. Real linking requires understanding: what is the essence of the issue? What is the intent of the change? Are they solving the same problem?

Questions worth asking if you work on traceability or code understanding: 1. Does my linking method rely only on surface features? 2. Could semantic understanding improve accuracy? 3. Am I considering all candidates, or only the top-ranked ones? 4. Could LLM reasoning help interpret the intent of code changes?

When an LLM understands issue-commit relationships at the semantic level, it upgrades from a "keyword matcher" to a "code archaeologist." In the history of a codebase, the best link is not the most exact match — it's the deepest understanding.

*Reference: arXiv:2605.00447*

Tags

#software-engineering#llm#issue-commit-linking#traceability#code-understanding#retrieval#re-ranking

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/177619364