Raw SignalOct 20, 20261 min read1 source

On public CyberBench , DeepSeek V4.1 Flash scores 73.69% at $0.07/test vs Sol's 77.98% at $1.34/test.

In one minute

Vals AI’s CyberBench v1.1 leaderboard compares systems on finding and patching security bugs.

DeepSeek V4.1 Flash records 73.69% accuracy at $0.07 per test; GPT-6 Sol records 77.98% at $1.34 per test. The listed results put GPT-6 Sol’s test cost at roughly 19 times DeepSeek V4.1 Flash’s, for a 4.29 percentage-point accuracy difference. These are benchmark results, not evidence of equivalent performance on production repositories or all security workflows.

Evidence / sources

  1. 1vals.ai/benchmarks/cyber
All Raw Signals

Next reads

Read next

Open the graph
  1. 01archiveRaw SignalsOpen every source-linked raw signal.
  2. 02source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract