Summarize this content to 100 words:
[Submitted on 9 Jun 2025 (v1), last revised 7 Feb 2026 (this version, v3)]
View a PDF of the paper titled Guideline Forest: Retrieval-Augmented Reasoning with Branching Experience-Induced Guidelines, by Jiaxiang Chen and 4 other authors
View PDF
HTML (experimental)
Abstract:Retrieval-augmented generation (RAG) has been widely adopted to ground large language models (LLMs) in external knowledge, yet it remains largely underexplored for improving reasoning. Existing methods either rely on online exploration during inference or heuristic supervision over reasoning trajectories, but they fail to effectively accumulate and reuse past reasoning experience. We propose Guideline Forest, a retrieval-augmented reasoning framework that explicitly leverages experience to guide multi-step reasoning. The framework stores high-quality, label-consistent reasoning traces as reusable memory, retrieves relevant experiences for new problems, and induces them into structured guidelines that steer reasoning and enable controlled branching and aggregation. Experiments on mathematical (GSM8K, MATH-500) and programming (MBPP, HumanEval) benchmarks demonstrate consistent improvements over strong reasoning baselines, including CoT, ReAct, ToT, FoT, and AFlow. Further analyses show that experience retrieval, guideline-induced diversity, and stepwise aggregation are key to the framework’s effectiveness. Beyond single-model reasoning, Guideline Forest generalizes to enhance diverse reasoning paradigms and supports multi-model collaboration, highlighting its flexibility and scalability.
Submission history From: Zhuo Wang [view email] [v1]
Mon, 9 Jun 2025 14:46:31 UTC (3,498 KB)
[v2]
Tue, 10 Jun 2025 02:05:49 UTC (3,498 KB)
[v3]
Sat, 7 Feb 2026 10:12:40 UTC (12,288 KB)
