Bias & Variance

[!def] Bias vs. Variance

• High Bias is the inability of the model to fit the training data
• High Variance is the inability of the model to fit the test data

[!def] Bias-Variance Tradeoff

• low bias, high variance - overfitting
• high bias, low variance - underfitting
• low bias, low variance - perfect fitting