protein language model distillation research

My STATS 326 project on protein language model distillation.

Distilling ESM-1b: A Compact Protein Language Model via Knowledge Distillation
Project Poster