Field noteNov 5, 20265 min read1 source

Language models can spend too much effort on easy questions and too little on steps that need checking

In one minute

Language models can spend too much effort on easy questions and too little on steps that need checking. A Habr article from MTS brings together research findings on overthinking and a reported Claude Code failure pattern after adaptive thinking became the default for Claude Opus 4.6. For builders, reasoning control is a calibration problem, not simply a longer-is-better setting.

What changed: The story frames adaptive reasoning time through fast-versus-slow thinking, asking how models should decide when a task merits more deliberation.

What happened

The article frames the problem as choosing how long a model should reason before answering. It contrasts early language models, which generated an answer token by token without a deliberate draft or check, with reasoning models that produce intermediate reasoning. OpenAI introduced o1 in September 2024, according to the article, and DeepSeek released the open-weight R1 model in January 2025. These systems made explicit reasoning more common, but the article says they also exposed a cost and quality problem: models could deliberate even on questions that did not warrant it.

One cited study from Tencent AI Lab, published in December 2024, asked reasoning models elementary questions. On “2+3,” QwQ-32B-Preview reportedly reached the correct answer after 39 tokens, then continued through twelve more approaches, using 901 tokens in total. The article says that, on average, the newer reasoning models used almost twenty times as many tokens as ordinary models to reach the same answer. It also describes research by Meta and the Hebrew University of Jerusalem comparing multiple reasoning traces from a model on the same question. The shortest trace could be more accurate than the longest, with a difference of up to 34.5%. A paper presented at ICLR 2026 is described as finding an inverted-U relationship: accuracy rises with reasoning length to a point, then falls.

The article also cites Anthropic research from summer 2025. In one example, models were asked to count an apple and an orange, while distracting details about the probability of their varieties were added. The longer Claude Opus 4 and DeepSeek R1 reasoned, the more often they incorporated the irrelevant probability details and got the count wrong. The article presents this as a mechanism for overthinking: extra steps can introduce mistakes, distort interpretation, or make a model doubt a correct answer.

The opposite failure appears in the article’s account of Claude Code. On February 9, 2026, Anthropic made adaptive thinking the default for Claude Opus 4.6: the model would decide whether and how much to think at each step instead of using a fixed reasoning-token budget. After developers reported superficially plausible but false details, including Stripe API versions, commit hashes, and package names, Claude Code creator Boris Cherny examined telemetry from problematic sessions. As reported in the article, users had high effort settings, but the model used no reasoning tokens on some steps where it invented facts. Cherny said the data suggested adaptive thinking was under-allocating reasoning on particular steps, and temporarily suggested disabling the adaptive mode and returning to a fixed budget.

What the archive adds

Reasoning from scratch: Implement a reasoning LLM in PyTorch, step by step is related background on reasoning models, but the archive entry describes a course rather than this event. This is a new fact on a known topic, not a restatement of that coverage.

Trend signal

No supplied SITE_PATTERNS entry directly describes adaptive allocation of reasoning effort. The article supports a narrower operational point: enabling reasoning is not enough; teams need to test whether it is allocated to the steps where it improves outcomes. That is not a strong enough fit to claim that a listed pattern is supported.

Why it matters

For teams building with models, reasoning is a resource decision with competing failure modes. Extra tokens add latency and cost, and the cited examples suggest they can also lower accuracy. Yet an adaptive controller that saves effort indiscriminately may skip a check precisely where a plausible-looking answer needs verification. A high-level effort setting alone may not ensure every consequential step receives enough scrutiny.

That changes how teams should evaluate reasoning features. Measure correctness and token use across task types, but also inspect error cases: did the model reason too long, stop too early, or fail to verify a concrete external fact? The article does not establish a universal fix, but it argues against treating either fixed long reasoning or automatic adaptive reasoning as inherently reliable. Production teams still need task-specific evaluation and an independent way to check claims that matter.

Limits and uncertainty

The supplied article excerpt reports research results and Claude Code incidents but does not provide complete methods, datasets, sample sizes, or links to the cited studies. The telemetry account is reported through the article; the excerpt does not establish how representative those sessions were or whether adaptive thinking caused each false claim. It also does not quantify latency, monetary cost, or any subsequent product changes. These examples indicate a calibration risk, not a general performance verdict on Claude Opus 4.6 or reasoning models as a class.

Reader takeaway

More reasoning is not automatically better, and adaptive reasoning is not automatically well calibrated. Treat the choice of when a model thinks as something to evaluate against your own tasks: check both whether unnecessary steps waste effort and whether important steps are skipped. For consequential facts, reasoning should complement verification, not replace it.

Evidence / sources

  1. 1habr.com/ru/companies/ru_mts/articles/1102766?amp%3Butm_medium=rss&amp%3Butm_source=habrahabr
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicClaudeExplore the claude topic hub.
  2. 02topicClaude CodeExplore the claude-code topic hub.
  3. 03topicAnthropicExplore the anthropic topic hub.
  4. 04archiveField NotesOpen the latest editorial analysis.
  5. 05source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract