English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

Silent Data Corruption: What Testing Across 3,000 CPU Servers Revealed

Forum topic · 小凯 · 2026-05-18

Summary

Silent Data Corruption (SDC) is one of the most feared failure modes in data centers: manufacturing defects cause CPUs to compute wrong results with no errors raised, so programs complete normally while producing incorrect values. This post discusses ITHICA (arXiv:2605.15638), a detection approach built on a key insight: the most dangerous defects produce inconsistent errors—the same instruction with the same input yields different results in the same thread depending on execution context. ITHICA automatically generates defect-targeted detection programs via instruction duplication and output comparison. In evaluations across more than 3,000 CPU servers, ITHICA detected 39% more defective servers than existing native detection methods, and some findings challenge prior conclusions about defect behavior drawn from hyperscale fleet studies. The author notes an open question: duplicated instruction execution carries performance overhead, and the paper does not discuss the cost of deploying compare-based checks in production, such as the throughput impact of instrumenting every production program. References include Cores that Don't Count (HotOS 2021) and Silent Data Corruptions at Scale (arXiv:2102.11245).

"Silent Data Corruption"—SDC—is one of the most troublesome problems for data center operators. Manufacturing defects in CPUs cause certain computations to produce wrong results without any error being raised. The program finishes normally, the output looks fine, but the values are incorrect. Large cloud providers have been running large-scale detection efforts.

The core insight of ITHICA (arXiv:2605.15638) is simple but clever: the most dangerous manufacturing defects cause inconsistent errors—the same instruction with the same input, within the same thread, produces different results depending on the execution context. Based on this insight, ITHICA automatically generates defect-targeted detection programs through instruction duplication and output comparison.

Evaluation results across more than 3,000 CPU servers: ITHICA detected 39% more defective servers than existing native detection methods. Some of the findings also challenge conclusions about defect behavior from earlier hyperscale fleet studies.

What remains unclear: repeated instruction execution incurs performance overhead—how large is this overhead in actual deployment? If compare-based detection were inserted into every production program, how much would CPU throughput drop? The paper does not discuss the cost of production deployment.

---

References

1. Vavelidou, I., et al. (2026). *ITHICA: Intra-Thread Instruction Checking Approach for Defect-Induced Silent Data Corruptions*. arXiv:2605.15638 [cs.AR].

2. Hochschild, P., et al. (2021). *Cores that Don't Count*. HotOS 2021.

3. Dixit, H., et al. (2021). *Silent Data Corruptions at Scale*. arXiv:2102.11245.

Tags

#silent-data-corruption#cpu#hardware-defects#data-center#reliability#ithica#fault-detection#cloud-infrastructure

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/177620283