Emergent Analogical Reasoning in Large Language Models

• https://arxiv.org/abs/2212.09196
• Taylor Webb, Keith J. Holyoak, Hongjing Lu

LLMs, Analogical reasoning

Here, we performed a direct comparison between human reasoners and a large language model (GPT-3) on a range of analogical tasks, including a novel text-based matrix reasoning task closely modeled on Raven’s Progressive Matrices. We found that GPT-3 displayed a surprisingly strong capacity for abstract pattern induction, matching or even surpassing human capabilities in most settings.