Here I try to explain the basic idea behind Knowledge distillation and how the technique helps in compressing large deep learning models.

Part 2 :    • Knowledge Distillation in Deep Learni...