Session Details

ML Summit
The big training event for Machine Learning
October 11 - 13, 2021 | Online April 2022 | Munich

Dr. Christian Winkler
Oliver Zeigermann


Bis zum 18. Februar anmelden und bis zu 200 € pro Ticket sparen! Jetzt anmelden
Early Bird:
Save up to
€ 200 per ticket!
Secure your ticket now
June 29 – July 1
Early Bird
Register now and save up to € 200!
Secure your ticket now

Natural Language Processing (NLP): The Transformer Zoo

Transformer-based language models have been at the core of the recent progress in Natural Language Processing (NLP). This original idea, based on transfer learning, has sparked a whole ecosystem. In this talk, we give a short retrospective about the different models starting with the original BERT, taking a look at derivatives like RoBERTa and AlBERT, stressing the differences to XLnet and GPT-{2,3}. As most of the research is still very academic, we show how the myriad of (fine-tuned) models available at Huggingface can be used very easily in Jupyter notebooks to solve real-world problems in different industries. Often, successful classification is only the first step to facilitate other machine learning tasks like trend prediction etc.

Session Tracks

#ML Conference