---
schema_version: "newruntime-agent-readable-v0.2"
type: "post"
stable_id: "post:google-agent-evaluations-offline-online"
slug: "google-agent-evaluations-offline-online"
title: "Google Runs The Same Agent Metrics Before And After Launch"
description: "Gemini Enterprise Agent Platform makes experiments, adaptive rubrics, trace review, simulations, online monitors, and drift alerts generally available on one evaluation engine."
retrieval_nugget: "Gemini Enterprise Agent Platform makes experiments, adaptive rubrics, trace review, simulations, online monitors, and drift alerts generally available on one evaluation engine. Google's Agent and Model Evaluations release closes a common measurement gap: the test suite used before launch and the monitoring system used afterward can now run the same metrics."
status: "published"
published_at: "2026-08-01"
updated_at: "2026-08-01"
record_date: "2026-08-01"
date_kind: "published_at"
topics: ["evals","agent-observability","simulation","quality-systems"]
source_urls: ["https://developers.googleblog.com/agent-and-model-evaluations-in-gemini-enterprise-agent-platform-are-now-ga"]
visuals: [{"id":"google-agent-evaluations-offline-online","kind":"editorial-diagram","role":"hero","src":"https://newruntime.com/images/posts/google-agent-evaluations-offline-online.webp","alt":"Hand-drawn evaluation loop where local cases, simulated users, and mocked tools use the same metric registry as sampled production traces and drift alerts.","caption":"Google connects pre-launch experiments and post-launch monitoring through one versioned metric registry.","credit":"New Runtime synthesis from Google Developers Blog","source_url":"https://developers.googleblog.com/agent-and-model-evaluations-in-gemini-enterprise-agent-platform-are-now-ga","generated_with":"gemini-3.1-flash-image","width":1600,"height":900,"legend":[{"label":"Experiment","description":"Datasets, simulated users, and mocked environments produce reproducible development traces."},{"label":"Metric registry","description":"Code checks and LLM judges are versioned once and reused across agents and stages."},{"label":"Monitor","description":"Sampled live traces receive the same scores, producing trends, clusters, and drift alerts."}]}]
telegram_message_id: 2906
telegram_url: "https://t.me/qwgai/2906"
telegram_message_ids: [2906,2907]
telegram_delivery_mode: "text_then_media"
telegram_media_url: "https://t.me/qwgai/2907"
routes: {"html":"https://newruntime.com/posts/google-agent-evaluations-offline-online/","markdown":"https://newruntime.com/posts/google-agent-evaluations-offline-online.md","json":"https://newruntime.com/posts/google-agent-evaluations-offline-online.json"}
source_format: "markdown"
---

# Google Runs The Same Agent Metrics Before And After Launch

## Retrieval answer

Gemini Enterprise Agent Platform makes experiments, adaptive rubrics, trace review, simulations, online monitors, and drift alerts generally available on one evaluation engine. Google's Agent and Model Evaluations release closes a common measurement gap: the test suite used before launch and the monitoring system used afterward can now run the same metrics.

Google's Agent and Model Evaluations release closes a common measurement gap: the test suite used before launch and the monitoring system used afterward can now run the same metrics.

The service ships with more than 20 metrics across quality, safety, grounding, tool use, trajectories, and reference-based tasks. Teams can also register deterministic Python checks or custom LLM judges. Every metric lives in a versioned organization-wide registry, so a production drift is less likely to be an artifact of changing the ruler.

Adaptive rubrics create case-specific pass/fail criteria from the task, developer instructions, and available tools. Google provides variants for task success, tool selection and arguments, trajectory quality, final responses, hallucination, grounding, and safety. Each failed run can be opened down to its trace and session log.

The experiment layer can generate cases, simulate multi-turn users, and intercept tool calls with a mocked environment. That makes it possible to force a slow backend, an error, or specific data without touching production. Server-side runs store artifacts in Cloud Storage for replay and audit.

After launch, online monitors sample real traces, apply the same metric definitions, and produce score-over-time dashboards and drift alerts. Issue clustering groups failures into an operator-defined taxonomy, turning a pile of low scores into a smaller set of repair queues.

The useful contract is continuous: every important metric must name the development cases it protects and the production traffic it samples. Offline green is a release condition. Online drift is a reason to create the next case.