Problem 7 - Olympiad

Which of the following best describes the bias-variance trade-off in machine learning?

A. High bias always implies low varianceB. It is the tension between underfitting and overfittingC. Bias controls noise in labels; variance controls noise in featuresD. Enlarging the dataset always reduces both bias and variance

Correct: B

Bias measures error from erroneous assumptions (underfitting), while variance measures error from sensitivity to training data (overfitting); reducing one often increases the other.