---
type: "raw_signal"
id: "arena-ai-replaced-bash-recovery-with-bash-reliability-3f9209"
slug: "arena-ai-replaced-bash-recovery-with-bash-reliability-3f9209"
title: "Arena.ai replaced Bash Recovery with Bash Reliability , scoring first-try shell command accuracy."
description: "Arena.ai has renamed its Bash Recovery signal to Bash Reliability and published a definition of how it is scored."
retrieval_nugget: "Arena.ai has renamed its Bash Recovery signal to Bash Reliability and published a definition of how it is scored."
observed_at: "2026-10-14"
record_date: "2026-10-14"
date_kind: "observed_at"
why_it_matters: "Arena.ai has renamed its Bash Recovery signal to Bash Reliability and published a definition of how it is scored. Each bash call is classified as a success, failure, or exempt. Agent-caused errors, such as a mistyped flag or a bug in an agent-written script, count as failures; external errors such as network outages are exempt. Tests that run correctly but reveal problems, and searches that return"
novelty: "notable"
verification_level: "source-linked"
signal_type: "research"
source_platform: "arena.ai"
topics: []
entities: ["Arena.ai","Agent Arena","Bash Reliability","Bash Recovery"]
related_patterns: []
source_url: "https://arena.ai/resources/agent-arena-signals"
source_urls: ["https://arena.ai/resources/agent-arena-signals"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "signal:arena-ai-replaced-bash-recovery-with-bash-reliability-3f9209"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/signals/arena-ai-replaced-bash-recovery-with-bash-reliability-3f9209/","markdown":"https://newruntime.com/signals/arena-ai-replaced-bash-recovery-with-bash-reliability-3f9209.md","json":"https://newruntime.com/signals/arena-ai-replaced-bash-recovery-with-bash-reliability-3f9209.json"}
---

# Arena.ai replaced Bash Recovery with Bash Reliability , scoring first-try shell command accuracy.

## Retrieval answer

Arena.ai has renamed its Bash Recovery signal to Bash Reliability and published a definition of how it is scored.

Arena.ai has renamed its Bash Recovery signal to Bash Reliability and published a definition of how it is scored. Each bash call is classified as a success, failure, or exempt. Agent-caused errors, such as a mistyped flag or a bug in an agent-written script, count as failures; external errors such as network outages are exempt. Tests that run correctly but reveal problems, and searches that return no results, count as successes. The model score is based on failures per non-exempt call, with more failures lowering its Net Improvement score. The supplied source defines the metric but does not report model scores, rankings, or the effect of the change on leaderboard outcomes.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- collection: [Raw Signals](https://newruntime.com/signals.json): Open every source-linked raw signal.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)