Knowledge Distillation

Compressing a large teacher model into a smaller student via soft target training.