A Simulation of p-Value Variation Across Replications

Recommended as a vivid visual demonstration of how unreliable p-values are.

Geoff Cumming uses a simulation to show how wildly the p value varies from one replication to the next because of sampling variability. He argues for estimation and confidence intervals over null hypothesis significance testing.