SciBERT https://arxiv.org/abs/1903.10676 https://github.com/allenai/scibert A BERT model trained on scientific texts.