Testing Distributed Systems with Deterministic Simulation

HN treats it as the canonical talk on simulation testing and a mind-blowing example of how far rigorous testing can go.

Will Wilson of FoundationDB explains how the team tested their distributed database using deterministic simulation. By running the whole system in a simulator with injected faults and reproducible seeds, they could find rare concurrency and network bugs.