What Does BERT Look At? An Analysis of BERT's Attention

• https://arxiv.org/abs/1906.04341
• Kevin Clark, Urvashi Khandelwal, Omer Levy, Christopher D. Manning

BERT, Attention mechanism