Copep

New preprint: CoPeP: Benchmarking Continual Pretraining for Protein Language Models. Spanning a decade of UniProt updates and 31 protein tasks, CoPeP shows that continual learning can leverage temporal information to outperform naive pre-training at scale. With Darshan Patil, Pranshu Malviya, Mathieu Reymond, and Sarath Chandar. In collaboration with Genentech.