· Xiaojing Yang · Statistics · 2 min read

中文

Effect Size: Statistical Significance Is Not Enough

A statistically significant result can still be too small to matter in research or deployment.

Core idea

Statistical significance asks whether an effect is detectable; effect size asks whether it matters.

1. Why this topic belongs early

AI papers often focus on whether a model beats another model. But a tiny gain can become statistically significant when the test set is large. The next question is practical and scientific: is the effect big enough to care about?

Two different questions
Difference
How far apart are the scores?
Uncertainty
Could noise explain it?
Effect size
How large is the effect?
Cost
What did we pay?
Claim
Is it worth saying?

2. Example

Model A: 87.20 accuracy
Model B: 87.35 accuracy
difference: +0.15

This might be statistically detectable on a huge benchmark. But if the model is twice as expensive, slower, less interpretable, or worse on rare safety-critical cases, the headline improvement is not enough.

3. AI/NLP effect sizes

ContextEffect-size question
ClassificationHow many more examples are corrected?
MTIs the BLEU/COMET gain visible in human error analysis?
RAGDoes the improvement reduce unsupported answers?
Bias evaluationIs the disparity practically meaningful?
SystemsIs the quality gain worth the cost and latency?

Metric improvement

A number moved.

Research contribution

The movement changed what the system can reliably do.

4. How I would write it

Instead of “our method significantly improves performance,” I prefer:

The improvement is statistically detectable but small; its practical value depends on whether the reduced terminology errors matter for the target domain.

Takeaway

Effect size is what keeps statistical testing connected to research meaning.

References and learning path

This note uses the statistics-to-machine-learning route that fits my AI/NLP research goals: build intuition with Seeing Theory and StatQuest, connect it to Python practice with Think Stats, then deepen the ML connection with ISLR/ISLP, CS229, and selected statistical inference references.

Share:
Back to Blog

Related Posts

View All Posts »