Large Language Models, ALBERT - A Lite BERT for Self-supervised Learning | Towards Data Science

Understand essential techniques behind BERT architecture choices for producing a compact and efficient model