Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs

• https://arxiv.org/pdf/2402.11442.pdf
• Siyuan Wang, Zhongyu Wei, Yejin Choi, Xiang Ren

LLMs, Rule based reasoning

we propose a logic scaffolding inferential rule generation framework, to construct an inferential rule base, ULogic, comprising both primitive and compositional rules across five domains