arXiv preprint ·
Higher Reasoning Effort Improves Reference Verifiability and Changes Reasoning Summaries in GPT-5.5
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
Large language models are increasingly being used in different stages of scientific knowledge production, including the suggestion of references. These models can operate at different levels of reasoning effort and provide summaries of their reasoning processes. This raises two questions: Does increasing reasoning effort improve the verifiability of generated references, and do the resulting reasoning summaries reveal how the model's behavior changes with greater effort? We examined summaries from GPT-5.5 as it generated scholarly references for 1,000 papers under paired low- and high-effort settings. Generated references were matched to external bibliographic records, and reasoning summaries were scored for four predefined features and explored for additional features discovered by GPT-5.5. High effort increased the mean paper-level resolver-verified reference rate from 78.3% to 84.8%, and produced longer reasoning summaries. All four predefined features received higher scores under high effort. The discovered features changed less uniformly: some appeared equally often in both conditions, whereas others were more common under high effort. Within each effort condition, neither feature set showed a consistent increase in verification rates with higher scores.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Computation & Language / NLP
Continual Learning Exam: Benchmarking Long-Horizon RSI and Experiential Learning in LLM Agents
Heard Enough to Act: Early Tool Calling in Spoken Dialogue Systems
How Do Small Coding Agents Use Code Graphs and Embeddings?
AdaTutor: Adaptive Tutoring through Pedagogical Strategy Selection
Beyond Belief: Evaluating and Mitigating LLM Susceptibility to Misinformation
Get the few papers worth your time in Computation & Language / NLP every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.