Overfitting is expected when we observe that?

1. A(A) With training iterations error on training set as well as test set decreases
2. B(B) With training iterations error on training set decreases but test set increases
3. C(C) With training iterations error on training set as well as test set increases
4. D(D) With training iterations training set as well as test error remains constant

Pick an option to check yourself, or open the answer below.

Show answer & explanation

Correct answer: B. (B) With training iterations error on training set decreases but test set increases