Laboratoire d'informatique de l'École polytechnique

Hallucinations in textual generation

Speaker: Oana Balalau (Cedar team)
Location: Salle Gilles Kahn (+ https://inria.webex.com/inria/j.php?MTID=mfd5733f913374fb9e53ec667855c8047)
Date: Thu, 21 Mar 2024, 13:00-14:00

In my work, I have studied two inverse problems: extracting facts in the form (subject, predicate, object) from text, and, given such facts, transforming them back into text. These problems are very interesting as they touch upon the issue of hallucinations in large language models. But they also open the question of when two sentences describe the same facts and how we can measure textual similarity in an informative and explainable manner. In this presentation, I will give a short overview of hallucinations and constraint generation, i.e., forcing the model to respect constraints defined for the task.