Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors

• https://arxiv.org/abs/2211.11031
  • https://github.com/Thartvigsen/GRACE
• Thomas Hartvigsen, Swami Sankaranarayanan, Hamid Palangi, Yoon Kim, Marzyeh Ghassemi

Model editing

Model editing can lead to degradation of the overall model performance. How can we keep updating (editing) the model continuously, ideally forever?

This paper’s method is the first one to successfully implement thousands of sequential edits using only streaming errors.