knowledge-distillation

paper summaries


An Image Is Worth 16x16 Words:Transformers For Image Recognition At Scale

Paper Summary

4 min read   ·   2022

A Simple Framework for Contrastive Learning of Visual Representations

Paper Summary

5 min read   ·   2022

Big Self-Supervised Models are Strong Semi-Supervised Learners

Paper Summary

7 min read   ·   2022

Big Self-Supervised Models Advance Medical Image Classification

Paper Summary

7 min read   ·   2022

Masked Autoencoders Are Scalable Vision Learners

Paper Summary

7 min read   ·   2022

DEIT - Training data-efficient image transformers & distillation through attention

Paper Summary

4 min read   ·   2022

Improving domain adaptation in de-identification of electronic health records through self-training

Paper Summary

4 min read   ·   2022

Zero-Shot Text-to-Image Generation

Paper Summary

5 min read   ·   2022

Contrastive Training for Improved Out-of-Distribution Detection

Paper Summary

9 min read   ·   2022

BEIT - BERT Pre-Training of Image Transformers

Paper Summary

5 min read   ·   2022

Attention is all you need

Paper Summary

7 min read   ·   2022