{"type":"post","id":"raindrop-simulations-enters-public-beta-for-pr-time-f89746","slug":"raindrop-simulations-enters-public-beta-for-pr-time-f89746","title":"Raindrop Simulations enters public beta for PR-time agent regression testing","description":"Raindrop has moved Simulations into public beta, offering teams a way to test agent changes against recreated production scenarios before merging a pull request.","retrieval_nugget":"Raindrop has moved Simulations into public beta, offering teams a way to test agent changes against recreated production scenarios before merging a pull request. The release matters because ordinary evals cover predefined cases, while changed prompts, tools, or code can create execution paths that require separate review.","published_at":"2026-11-05","updated_at":"2026-11-05","record_date":"2026-11-05","date_kind":"published_at","topics":["coding-agents","agent-ops"],"entities":["Raindrop","Raindrop Simulations","Ben Hylak","Caddy","LEAP CRM","LEAP Legal"],"related_patterns":["verification-bandwidth-is-the-scarce-resource"],"novelty_label":"new_fact","what_changed":"Raindrop’s Simulations product—not SyntropyLabs—has entered public beta, testing agent changes against recreated production scenarios and reporting 33,000+ simulations across 1,700+ pull requests.","prior_refs":["https://newruntime.com/posts/syntropylabs-launches-publicly-as-an-ai-observability-evaluation-ec1bfd/"],"source_url":"https://www.raindrop.ai/blog/introducing-simulations","source_urls":["https://www.raindrop.ai/blog/introducing-simulations"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:raindrop-simulations-enters-public-beta-for-pr-time-f89746","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/raindrop-simulations-enters-public-beta-for-pr-time-f89746/","markdown":"https://newruntime.com/posts/raindrop-simulations-enters-public-beta-for-pr-time-f89746.md","json":"https://newruntime.com/posts/raindrop-simulations-enters-public-beta-for-pr-time-f89746.json"},"markdown_url":"https://newruntime.com/posts/raindrop-simulations-enters-public-beta-for-pr-time-f89746.md","next_reads":[{"type":"topic","path":"/topics/coding-agents/","url":"https://newruntime.com/topics/coding-agents/","title":"Coding Agents","reason":"Explore the coding-agents topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/coding-agents.md","json_url":"https://newruntime.com/topics/coding-agents.json"},{"type":"topic","path":"/topics/agent-ops/","url":"https://newruntime.com/topics/agent-ops/","title":"Agent Ops","reason":"Explore the agent-ops topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/agent-ops.md","json_url":"https://newruntime.com/topics/agent-ops.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}