{"type":"post","id":"openhack-publishes-pentestbench-v1-an-open-source-web-92d533","slug":"openhack-publishes-pentestbench-v1-an-open-source-web-92d533","title":"OpenHack publishes PentestBench v1, an open-source web pentest benchmark","description":"OpenHack published PentestBench v1, a white-box benchmark of model-and-harness configurations searching for web vulnerabilities in 17 applications containing 761 planted flaws.","retrieval_nugget":"OpenHack published PentestBench v1, a white-box benchmark of model-and-harness configurations searching for web vulnerabilities in 17 applications containing 761 planted flaws. Its results put OpenHack’s own configuration first, while showing how recall and precision can diverge. For teams evaluating security agents, the release offers a concrete comparison framework—but not an independent verdict on real-world performance.","published_at":"2026-11-17","updated_at":"2026-11-17","record_date":"2026-11-17","date_kind":"published_at","topics":["claude","claude-code"],"entities":["OpenHack","PentestBench","Mythos 5.2","Claude Code","Claude Security","Semgrep CE","GPT-6 Astra","OpenAI"],"related_patterns":[],"novelty_label":"new_fact","what_changed":"OpenHack has published PentestBench v1, a white-box web penetration-testing benchmark spanning 17 apps and 761 planted vulnerabilities, with early model and scanner results.","prior_refs":["https://newruntime.com/posts/cwe-bench-v2-more-coverage-quality-and-transparency-c19762/"],"source_url":"https://pentestbench.com/","source_urls":["https://pentestbench.com/"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:openhack-publishes-pentestbench-v1-an-open-source-web-92d533","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/openhack-publishes-pentestbench-v1-an-open-source-web-92d533/","markdown":"https://newruntime.com/posts/openhack-publishes-pentestbench-v1-an-open-source-web-92d533.md","json":"https://newruntime.com/posts/openhack-publishes-pentestbench-v1-an-open-source-web-92d533.json"},"markdown_url":"https://newruntime.com/posts/openhack-publishes-pentestbench-v1-an-open-source-web-92d533.md","next_reads":[{"type":"topic","path":"/topics/claude/","url":"https://newruntime.com/topics/claude/","title":"Claude","reason":"Explore the claude topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude.md","json_url":"https://newruntime.com/topics/claude.json"},{"type":"topic","path":"/topics/claude-code/","url":"https://newruntime.com/topics/claude-code/","title":"Claude Code","reason":"Explore the claude-code topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/claude-code.md","json_url":"https://newruntime.com/topics/claude-code.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}
