Explores the mathematics of language models, covering architecture design, pre-training, and fine-tuning, emphasizing the importance of pre-training and fine-tuning for various tasks.
Explores word embeddings, models like CBOW and Skipgram, Fasttext, Glove, subword embeddings, and their applications in document search and classification.