Explores pretraining sequence-to-sequence models with BART and T5, discussing transfer learning, fine-tuning, model architectures, tasks, performance comparison, summarization results, and references.
Explores natural language generation, focusing on building systems that produce coherent text for human consumption using various decoding methods and evaluation metrics.
