Estimating the Hallucination Rate of Generative AI

• https://arxiv.org/abs/2406.07457
• Andrew Jesson, Nicolas Beltran-Velez, Quentin Chu, Sweta Karlekar, Jannik Kossen, Yarin Gal, John P. Cunningham, David Blei

They define Hallucination in a specific way:

we define a hallucination as a generated prediction that has low- probability under the true latent parameter.