Explores pretraining sequence-to-sequence models with BART and T5, discussing transfer learning, fine-tuning, model architectures, tasks, performance comparison, summarization results, and references.
Explores a unified framework for understanding and evaluating generative sequence models of DNA/RNA or Protein, covering topics like coevolution, conservation, and different models such as GREMLIN and BERT.
