论文标题

在大型语言模型中进行推理:一项调查

Towards Reasoning in Large Language Models: A Survey

论文作者

Huang, Jie, Chang, Kevin Chen-Chuan

论文摘要

推理是人类智能的基本方面,它在解决问题,决策和批判性思维等活动中起着至关重要的作用。近年来,大型语言模型(LLMS)在自然语言处理方面取得了重大进展,并且有观察到这些模型在足够大时可能会表现出推理能力。但是,尚不清楚LLM在多大程度上能够推理。本文概述了LLM中推理的当前知识状态,包括用于改进和引发推理的技术,方法和基准,用于评估该领域的推理能力,发现和启示,以及对未来方向的建议。我们的目标是对该主题提供详细的最新评论,并刺激有意义的讨论和未来的工作。

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in natural language processing, and there is observation that these models may exhibit reasoning abilities when they are sufficiently large. However, it is not yet clear to what extent LLMs are capable of reasoning. This paper provides a comprehensive overview of the current state of knowledge on reasoning in LLMs, including techniques for improving and eliciting reasoning in these models, methods and benchmarks for evaluating reasoning abilities, findings and implications of previous research in this field, and suggestions on future directions. Our aim is to provide a detailed and up-to-date review of this topic and stimulate meaningful discussion and future work.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源