Deep Learning for NLPDelves into Deep Learning for Natural Language Processing, exploring Neural Word Embeddings, Recurrent Neural Networks, and Attentive Neural Modeling with Transformers.
Pretraining: Transformers & ModelsExplores pretraining models like BERT, T5, and GPT, discussing their training objectives and applications in natural language processing.
Modern NLP: IntroductionBy Antoine Bosselut introduces Natural Language Processing and its challenges, advancements in neural models, and course goals.
Neural Networks for NLPCovers modern Neural Network approaches to NLP, focusing on word embeddings, Neural Networks for NLP tasks, and future Transfer Learning techniques.