Thinking to recall: How reasoning unlocks parametric knowledge in LLMs
Reasoning can help LLMs recall simple facts even when no genuine multi-step deduction is required. Experiments with Gemini-2.5 and Qwen3 show that reasoning improves access to facts stored in model weights through two mechanisms: extra reasoning tokens provide computational capacity, while related factual statements prime retrieval. However, natural reasoning remains more effective than empty computation, and self-generated intermediate facts can introduce hallucination risks. ## Measuring the Knowledge Boundary - The researchers use **pass@k** to determine whether a correct answer appears among multiple generated attempts, rather than evaluating only the top answer. - They compare reasoning-enabled and reasoning-disabled versions of Gemini-2.5 Flash, Gemini-2.5 Pro, and Qwen3-32B. - Tests use the closed-book **SimpleQA Verified** and **EntityQuestions** datasets, which mainly contain simple, single-hop factual questions. - Reasoning-enabled models recover answers that are nearly unreachable when reasoning is disabled, showing that the benefit is not limited to solving complex problems. ## The Computational Buffer - Generating additional reasoning tokens gives the model more forward passes and therefore more opportunities to update its internal state. - To isolate this effect, the researchers replace the model’s natural reasoning with repeated meaningless text such as “Let me think.” - This dummy reasoning substantially improves factual recall compared with having reasoning completely turned off. - The effect has limits: - Longer dummy traces eventually produce diminishing returns. - Dummy reasoning never performs as well as natural reasoning. - These results indicate that extra computation helps, but the semantic content of the reasoning trace also contributes. ## Factual Priming - Natural reasoning traces often contain related facts rather than logical deductions. - This resembles **spreading activation** in human memory, where recalling one concept makes related concepts easier to access. - The researchers call this mechanism **factual priming**: the model generates nearby facts that create a contextual bridge to the target fact. - When the researchers extract only concrete facts from reasoning traces—removing filler, search plans, and the target answer itself—those facts recover most of reasoning’s benefit. - For example, when asked for Nepal’s 10th king, the model may recall the first nine kings. Listing those related facts primes retrieval of the requested answer. ## The Hallucination Trap - Generative self-retrieval depends on facts produced by the model during reasoning. - Because those intermediate facts may be hallucinated, factual priming can potentially reinforce incorrect information. - The excerpt introduces this risk but does not provide the researchers’ full evaluation or mitigation findings. The practical conclusion is that reasoning traces can function both as a computational workspace and as a semantic memory primer. For factual recall, systems should preserve useful intermediate retrieval while monitoring or verifying generated facts, since the same mechanism that unlocks obscure knowledge can also amplify errors.
Read original(opens in new tab)