---
type: "post"
id: "recursive-model-card-reports-flint-s-89-7-cdd01f"
slug: "recursive-model-card-reports-flint-s-89-7-cdd01f"
title: "Recursive model card reports Flint’s 89.7% SWE-bench Pro v2 score"
description: "Recursive’s Flint model card reports 89.7% on SWE-bench Pro v2, alongside scores on SWE-bench Verified and Terminal-Bench 2.1."
retrieval_nugget: "Recursive’s Flint model card reports 89.7% on SWE-bench Pro v2, alongside scores on SWE-bench Verified and Terminal-Bench 2.1. The result makes Flint worth testing for coding-agent teams, but Recursive’s own evaluation setup and substantial GPU requirements matter as much as the headline score."
published_at: "2026-11-13"
updated_at: "2026-11-13"
record_date: "2026-11-13"
date_kind: "published_at"
topics: ["models","evals","coding-agents"]
entities: ["Recursive","Flint","SWE-bench Pro v2","SWE-bench Verified","Terminal-Bench 2.1","SGLang"]
related_patterns: ["ai-engineering-evaluations-are-splitting-into-task-specific"]
novelty_label: "new_fact"
what_changed: "Flint’s model card now reports an 89.7% score on SWE-bench Pro v2."
prior_refs: []
source_url: "https://huggingface.co/RecursiveSI/flint/blob/main/README.md"
source_urls: ["https://huggingface.co/RecursiveSI/flint/blob/main/README.md"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:recursive-model-card-reports-flint-s-89-7-cdd01f"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/recursive-model-card-reports-flint-s-89-7-cdd01f/","markdown":"https://newruntime.com/posts/recursive-model-card-reports-flint-s-89-7-cdd01f.md","json":"https://newruntime.com/posts/recursive-model-card-reports-flint-s-89-7-cdd01f.json"}
markdown_url: "https://newruntime.com/posts/recursive-model-card-reports-flint-s-89-7-cdd01f.md"
---

# Recursive model card reports Flint’s 89.7% SWE-bench Pro v2 score

## Retrieval answer

Recursive’s Flint model card reports 89.7% on SWE-bench Pro v2, alongside scores on SWE-bench Verified and Terminal-Bench 2.1. The result makes Flint worth testing for coding-agent teams, but Recursive’s own evaluation setup and substantial GPU requirements matter as much as the headline score.

## Summary
Recursive’s Flint model card reports 89.7% on SWE-bench Pro v2, alongside scores on SWE-bench Verified and Terminal-Bench 2.1. The result makes Flint worth testing for coding-agent teams, but Recursive’s own evaluation setup and substantial GPU requirements matter as much as the headline score.

## What happened
Recursive’s Flint model card describes the model as a mixture-of-experts language model built for coding agents. It has 39.8 billion total parameters and approximately 2.5 billion active parameters per token, including the output head; the active body alone is about 2.2 billion. The model is designed to investigate codebases, fix bugs, implement features and write tests. Its documented context configuration is 262,144 tokens, shared between the prompt and generated output. It accepts and produces text, supports reasoning and multi-turn tool use, and lists a June 2026 knowledge cutoff.

In its release evaluations, Recursive reports 89.7% on SWE-bench Pro v2, 74.2% on SWE-bench Verified and 54.9% on Terminal-Bench 2.1. The card says SWE-bench evaluations use mini-swe-agent and Terminal-Bench uses Terminus 2. Agentic scores are average pass@1 across at least five attempts. Recursive gives temperature 1.0, top-p 0.95 and top-k 20 as evaluation settings, and recommends an output budget of at least 32,768 tokens for hard problems. The serving server applies the listed sampling settings when a request omits them. The card also says Terminal-Bench counts solutions obtained through web retrieval as unsuccessful, a qualification that may not apply to developer-reported comparison scores. Evaluation setups vary across sources.

The repository contains a BF16 checkpoint, model configuration, tokenizer, chat template and SGLang serving kit. Recursive says the model can run on one B300 or H200 GPU per replica using its SGLang kit, and estimates the model download at about 80 GB. It documents an OpenAI-compatible API and tool calls. The model card says Transformers modeling code is not included yet; quantized variants are prepared separately for NVIDIA and Apple Silicon runtimes. The repository identifies the model as Apache 2.0 licensed. Hosted API terms and data practices, if any, are separate from that weights license.

The card says Flint was trained from scratch through pretraining, mid-training, supervised fine-tuning and reinforcement learning, on text and code, instruction-following and agentic tasks. Recursive warns that the model can generate incorrect or harmful content, faulty code and inappropriate tool calls. It calls on users to test generated code, review consequential changes and enforce permissions and execution boundaries in tool-using applications. Long reasoning can add latency or consume the output budget before an answer is complete; the stated context capacity does not guarantee consistent accuracy across lengths or tasks.

## What the archive adds
New Runtime covered Flint’s launch and local coding capabilities on [October 22, 2026](https://newruntime.com/posts/recursive-releases-flint-40b-model-for-local-coding-6ca7fb/). A separate earlier note described its laptop ambitions and early limitations. The score is a new fact in an ongoing Flint story, not a new model release. New Runtime’s [implementation note on Flint support](https://newruntime.com/posts/model-add-flint-recursivesi-flint-bcba9d/) covers BF16 and NVFP4 checkpoints and Flint-specific kernels, rather than independently validating this benchmark result.

## Trend signal
This result meets New Runtime’s [evaluation-set assumption](https://newruntime.com/analysis/research-flint-s-89-7-most-likely-uses-scale-s-swe-bench-pro-v2-tasks-but-not-scale-s/): public benchmark scores may not predict performance on private tasks, especially where public fixes can be memorized. The model card provides a score and setup, but not a private-set comparison. The result supports treating benchmark scores as screening evidence, not a substitute for testing on a team’s own repositories and review process.

## Why now
The score extends a continuing evaluation of Flint after its launch and implementation coverage. Recursive’s current model card reports the benchmark figures alongside the hardware, runtime and evaluation details teams need to judge whether the result is worth reproducing.

## Why it matters
For a team choosing a coding model, the headline 89.7% is less useful than the combination of task fit, reproducibility and deployment cost. Flint is available under Apache 2.0, but the listed one-B300-or-H200-per-replica requirement and roughly 80 GB download set a high bar for local evaluation. The model card also warns that performance may vary with checkpoint precision and inference runtime, so a result measured on one setup should not be assumed to transfer to another.

The practical decision is whether Flint solves your own engineering tasks reliably enough to justify that infrastructure. Run a small, controlled test on representative issues, preserve the checkpoint and runtime details, and inspect patches and tool calls. Compare verified completions and review effort, not only pass rates. The model card itself says code and consequential changes need human review and that tool permissions must be enforced outside the model. Those controls remain necessary even when a benchmark score is strong.

## What happens next
- **Teams that adopt Flint for real workloads will publish more reproducible, hardware-specific coding evaluations** (6 months, 55%). Watch for: public results naming checkpoint revision, inference runtime and task set.

## Limits and uncertainty
The scores are Recursive’s release-evaluation claims; the model card does not establish an independent replication of the 89.7% result. It notes that evaluation setups differ across sources, so comparisons may not be like-for-like. The README does not provide a private-repository result or a measure of human review effort, production success, latency or cost per completed task. Recursive also says results can vary with precision and runtime. Its own limitations warn that the context length is a capacity setting rather than an accuracy guarantee, and that generated code and tool calls can be incorrect or unsafe.

## Skill to build now
Build a small coding-agent evaluation set from issues your team has already resolved. Keep the issue description, expected tests, repository revision and acceptable patch criteria fixed; then run the same tasks with the exact Flint checkpoint and runtime you plan to deploy. Record pass@1, time, failures and reviewer corrections, and inspect every tool call. This turns a public benchmark claim into evidence about your own codebase without treating a single score as a deployment decision.

## Reader takeaway
Flint’s 89.7% SWE-bench Pro v2 score is a meaningful claim to investigate, not proof that it will work on your codebase. Recursive supplies useful setup details, but teams still need to reproduce results on representative tasks, account for substantial GPU needs, and verify code and tool use.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Models](https://newruntime.com/topics/models.md): Explore the models topic hub.
- topic hub: [Evals](https://newruntime.com/topics/evals.md): Explore the evals topic hub.
- topic hub: [Coding Agents](https://newruntime.com/topics/coding-agents.md): Explore the coding-agents topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Sources](https://newruntime.com/sources/): See the original sources this archive cites.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)