English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

MineValiCoder: Reliable Code Generation with Test Case Quality Mining

Forum topic · 小凯 · 2026-07-28

Summary

MineValiCoder is a collaborative closed-loop Test-Driven Development (TDD) framework that improves the reliability of LLM-based automated code generation by exploiting the mutual reinforcement between test-case quality and code quality. The framework consists of three modules: a Test Case Quality Mining (TCQM) module that filters faulty tests via self-validation to provide reliable optimization supervision; a parallel TDD refinement module that iteratively optimizes code using validated test feedback and generates diverse high-quality candidates; and a Bipartite Code-Test Mutual Validation (BiCoTeV) module that dynamically models code-test interactions with mutual validation scoring for stable selection of the best solution. Evaluations across four LLMs and mainstream benchmarks show MineValiCoder significantly outperforms state-of-the-art methods, achieving 96.34% Pass@1 on HumanEval, 87.40% on MBPP, 64.00% on APPS, and 51.33% on LiveCodeBench. Paper: arXiv 2607.22471.

Paper Overview

Field: ML Authors: Zhen Zhao, Qihang Yang, Feifei Dai, Xiangfang Li, Bo Li arXiv: 2607.22471

Abstract (English)

Large Language Model (LLM)-based Test-Driven Development (TDD) has advanced automated code generation. However, existing approaches depend heavily on human-crafted test cases and cannot operate effectively when only natural-language requirements are available. Although recent work enables automatic test generation, it often overlooks the inherent stochasticity of LLMs, leading to two key defects: faulty tests generate misleading feedback that distorts code optimization, while mixed-quality test cases produce conflicting evaluation signals that hinder reliable code selection.

To address these challenges, the authors propose MineValiCoder, a collaborative closed-loop TDD framework based on the mutual reinforcement of test-case quality and code quality. MineValiCoder comprises three modules:

  • Test Case Quality Mining (TCQM): filters faulty test cases via self-validation, providing reliable optimization supervision.
  • Parallel TDD Refinement: iteratively optimizes code using validated test-case feedback and generates diverse, high-quality code candidates.
  • Bipartite Code-Test Mutual Validation (BiCoTeV): dynamically models code-test interactions and performs mutual validation scoring for stable, reliable selection of the best code.
Extensive evaluations across four LLMs and mainstream benchmarks show that MineValiCoder significantly outperforms state-of-the-art methods:

| Benchmark | Pass@1 | |---|---| | HumanEval | 96.34% | | MBPP | 87.40% | | APPS | 64.00% | | LiveCodeBench | 51.33% |

These results demonstrate MineValiCoder's effectiveness in mitigating LLM stochasticity and improving the reliability of automated code generation.

Tags

#llm#code-generation#test-driven-development#arxiv#machine-learning#paper

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178503751