← Back to Glossary Index AI Glossary Term Model Distillation Definition Training smaller student models on output targets of larger teacher models. Related Concepts Fine-Tuning