Back to results for “Fundamentals”
Machine Learning Fundamentals › Bias-Variance Tradeoff

What are common mistakes to avoid with Bias-Variance Tradeoff

Intermediate

Answer

A common mistake is only focusing on reducing training error, since that usually increases variance and hurts performance on new data.
Real-world example A simple straight line model predicting house prices may miss important patterns, high bias, while a very complex model may fit every small detail of the training houses and fail on new houses, high variance.

Common follow-ups: What is overfitting, What is regularization, What is model complexity