SPECTER: Document-level Representation Learning using Citation-informed Transformers https://www.aclweb.org/anthology/2020.acl-main.207/ A Transformer model that also uses the relational information (Citation).