Bias-variance tradeoff

Simpler models tend to have more bias (does not fit well), while less variance (generalizes well).

See Double descent