Fast model editing at scale

• https://arxiv.org/abs/2110.11309
• Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, Christopher D. Manning

Model editing is a process of adjusting a trained model’s behavior. For instance, the “fact” can be changing over time (e.g., “who is the POTUS?”). This paper proposes a method to edit a pre-trained model.

MEND (Model Editor Networks with Gradient Decomposition).

What is gradient decomposition?