Gist catalog highlights AI study failure modes

This catalogue outlines nineteen common failure modes in AI-assisted scientific studies, ranging from unequal comparisons and omitted baselines to adaptive overfitting, pseudoreplication, and distribution shift. The author provides illustrative examples for each error and suggests practical design repairs and verification checks to ensure that published claims accurately reflect what was measured. Open article →