Lesson 4 of 21 · Part I, Foundations

Generalization and validation

Underfitting and overfitting on polynomial fitting, the VC-bound, hold-out and K-fold, confusion matrix and ROC curve.

10 figures to manipulate.

In this lesson

• ML in brief
• The fundamental problems of ML
• A case study: polynomial fitting
• Toward Statistical Learning Theory
• Validation
• Accuracy in classification
• The design cycle
• Interpretation errors

Other lessons

Fundamental concepts of ML · Linear models and K-nearest neighbors · All lessons

Notes by Fabio Piscitelli — Machine Learning (654AA), Prof. Alessio Micheli, University of Pisa, a.y. 2026/27.