DeiT Paper Walkthrough: Vision Transformer on a Budget | Towards Data Science
Understanding how DeiT works via knowledge distillation —and how to implement it with PyTorch

Source: Towards Data Science
Understanding how DeiT works via knowledge distillation —and how to implement it with PyTorch