Field noteNov 2, 20265 min read1 source

Heads of Security: learned per-head attention gates cut adaptive prompt-injection success on GPT-OSS-20B from 97% to 10%

In one minute

A new paper introduces Heads of Security (HoS), a model-architecture defense that learns attention gates to separate trusted instructions from untrusted content. On GPT-OSS-20B, the authors report that one adaptive black-box attack’s success rate falls from 97% on the base model to 10% with HoS, a result worth tracking without treating it as proof of deployment readiness.

What changed: The paper introduces a learned per-head attention-gate defense and reports adaptive-attack success falling from 97% on GPT-OSS-20B to 10% with HoS; the priors cover other prompt-injection techniques and defenses.

What happened

In *Heads of Security: Learned Attention Gates Improve Prompt Injection Robustness*, Igor Shilov and eight co-authors describe a defense they call HoS. The paper was submitted to arXiv on October 27, 2026, and revised on October 30. It evaluates the approach on Llama-3.3-70B-Instruct and GPT-OSS-20B, comparing it with SecAlign++ and ASIDE. The authors frame the problem as instruction-data separation: models need to reason over untrusted content without treating instructions embedded in that content as authoritative.

HoS learns a small set of per-head attention gates. These gates control how each attention head redistributes attention between trusted and untrusted tokens. The proposal is therefore an intervention in model architecture, rather than a request in the prompt that the model should ignore malicious instructions. The abstract does not give implementation instructions or describe a generally available software package; it reports an evaluated defense.

The headline result concerns RL-Hammer, described as a black-box adaptive attack. Against GPT-OSS-20B, the attack reaches a 97% attack success rate on the base model and 85% against SecAlign, but 10% against HoS. The paper also reports results for Claudini, a state-of-the-art white-box attack strengthened against HoS through autoresearch: it requires three times more FLOPs to reach the same attack success rate on HoS as on GPT-OSS-20B or SecAlign. These figures indicate resistance in the authors’ test conditions, not elimination of prompt injection.

The authors say HoS preserves base-model utility across standard multiple-choice benchmarks and prompting setups, while SecAlign and ASIDE degrade in few-shot settings. On agentic benchmarks with static attacks, HoS and SecAlign perform similarly and substantially improve the security-utility trade-off over the base model; ASIDE has only 10% utility on tool use. The abstract does not specify all benchmark names, attack counts, confidence intervals, or how the reported utility score is calculated. The evidence available here is the paper’s own abstract and summary, so the results should be read as a research claim pending independent reproduction and inspection of the full experimental detail.

What the archive adds

This is a new research result within an established prompt-injection thread. The archive previously covered CrowdStrike’s taxonomy expansion to 222 prompt-injection techniques, which described attack coverage, including attacks on agent planning. HoS adds an evaluated defense result, rather than another catalog of attack techniques. It is not the same event, and the taxonomy does not validate these experiments.

Trend signal

HoS is a qualified signal for agent security moving to runtime boundaries: it places instruction-data separation in learned attention behavior rather than relying only on a prompt telling a model what to trust. The paper tests an architectural intervention, not a complete runtime that governs reading, execution, memory, or authorization. It therefore supports the broader move toward enforceable boundaries, but does not establish that model-level gates are sufficient for deployed agents.

Connections to other events

The earlier CrowdStrike taxonomy coverage and this paper meet at the same practical problem: content supplied to an agent can carry instructions that compete with the operator’s intent. The taxonomy broadens the map of attack techniques; HoS asks whether a model can be changed to resist some adaptive attacks while remaining useful. Together they point to two distinct workstreams—characterizing attacks and evaluating defenses—rather than evidence that one approach closes the other’s gaps.

Why it matters

For teams building agents that read web pages, emails, or tool outputs, prompt injection is not merely a wording problem. HoS offers evidence that a model can be trained to treat trusted and untrusted tokens differently through learned attention controls, and its reported RL-Hammer result is a substantial change relative to the two comparison systems named in that test. Its utility findings also address a crucial deployment trade-off: a defense that blocks attacks but makes normal tool use unusable is not enough.

The immediate value is as an evaluation target, not as an instruction to replace existing safeguards. Security teams can ask whether their current model and agent stack has been tested against adaptive as well as static attacks, and whether utility is measured alongside attack success. The result also reinforces the need to test at the system boundary: even if a model becomes harder to manipulate, permissions and execution controls still determine what a successful manipulation could do. HoS does not report those broader controls or demonstrate a complete deployed agent system.

Limits and uncertainty

The paper’s reported numbers are specific to two evaluated models, the named defenses, and the authors’ attack and benchmark setups. An attack success rate of 10% is not zero, and the abstract does not establish performance against every injection strategy, model family, language, or real-world workflow. It also does not establish whether the gates can be applied to arbitrary models, how costly training or inference is, or what operational changes deployment would require. The supplied material does not report an independent replication, a released implementation, or evidence from production systems. These unknowns limit conclusions about generality and readiness.

Reader takeaway

HoS reports that learned per-head attention gates can sharply reduce the success of a particular adaptive prompt-injection attack while retaining utility in the authors’ evaluated settings. Treat that as promising defense research, not a solved security problem or a drop-in product. For builders, the durable lesson is to evaluate attack resistance and task utility together—and to keep system-level permissions and execution boundaries in place.

Open question

Can the reported gains be independently reproduced across more model families and realistic agent workflows without weakening legitimate tool use?

Evidence / sources

  1. 1arxiv.org/abs/2610.37657
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicPrompt InjectionExplore the prompt-injection topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03sourcesSourcesSee the original sources this archive cites.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract