Lesson 12 of 21 · Part III, Validation and theory

Statistical Learning Theory and VC-dimension

Shattering and VC-dimension (lines in the plane have 3), VC-dim and number of parameters, the VC-bound on the risk and Structural Risk Minimization on nested structures.

5 figures to manipulate.

In this lesson

• The VC-dimension
• The analytical bound on the risk
• Structural Risk Minimization

Other lessons

Validation (part 3) — typical mistakes and FAQ · Support Vector Machines · All lessons

Notes by Fabio Piscitelli — Machine Learning (654AA), Prof. Alessio Micheli, University of Pisa, a.y. 2026/27.