---
type: "post"
id: "cohere-retrieval-models-on-openrouter-0f444f"
slug: "cohere-retrieval-models-on-openrouter-0f444f"
title: "Cohere retrieval models on OpenRouter"
description: "Cohere says Embed 5 and Rerank 5 are now available through OpenRouter, using its API and billing surface."
retrieval_nugget: "Cohere says Embed 5 and Rerank 5 are now available through OpenRouter, using its API and billing surface. The practical news is not a new retrieval method but a lower-friction route to combine Cohere’s embedding and reranking models in a RAG pipeline, including a Pro-index/Fast-query split that Cohere tested against 40 datasets."
published_at: "2026-11-05"
updated_at: "2026-11-07"
record_date: "2026-11-05"
date_kind: "published_at"
topics: ["models"]
entities: ["Cohere","Embed 5","Rerank 5","OpenRouter","DeepSeek V4.1 Flash"]
related_patterns: ["agent-protocols-become-interoperability-layer"]
novelty_label: "same_event"
prior_refs: []
source_url: "https://cohere.com/blog/embed-rerank-5-openrouter"
source_urls: ["https://cohere.com/blog/embed-rerank-5-openrouter"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:cohere-retrieval-models-on-openrouter-0f444f"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/cohere-retrieval-models-on-openrouter-0f444f/","markdown":"https://newruntime.com/posts/cohere-retrieval-models-on-openrouter-0f444f.md","json":"https://newruntime.com/posts/cohere-retrieval-models-on-openrouter-0f444f.json"}
markdown_url: "https://newruntime.com/posts/cohere-retrieval-models-on-openrouter-0f444f.md"
---

# Cohere retrieval models on OpenRouter

## Retrieval answer

Cohere says Embed 5 and Rerank 5 are now available through OpenRouter, using its API and billing surface. The practical news is not a new retrieval method but a lower-friction route to combine Cohere’s embedding and reranking models in a RAG pipeline, including a Pro-index/Fast-query split that Cohere tested against 40 datasets.

## Summary
Cohere says Embed 5 and Rerank 5 are now available through OpenRouter, using its API and billing surface. The practical news is not a new retrieval method but a lower-friction route to combine Cohere’s embedding and reranking models in a RAG pipeline, including a Pro-index/Fast-query split that Cohere tested against 40 datasets.

## What happened
In a November 4, 2026 blog post, Cohere announced that Embed 5 and Rerank 5 are live on OpenRouter. The post frames the change for developers already using OpenRouter: they can use the same API key and credits, with no additional setup or SDK. It demonstrates a Python workflow for answering questions over a small document collection with scored citations. The code uses Python 3.10 or newer, the OpenRouter Python SDK, NumPy, and an OpenRouter API key. The example’s chat model is DeepSeek V4.1 Flash, though Cohere says any chat model available on OpenRouter can fill that role.

The walkthrough separates indexing from serving questions. Indexing is run once for a corpus: documents are chunked, embedded with `cohere/embed-5-pro`, and normalized into vectors. The example uses 1,024 dimensions, while Embed 5 offers six sizes—256, 512, 768, 1,024, 1,536, and 2,048—with 2,048 as the default. Cohere recommends 1,024-dimensional int8 vectors as a quality-to-cost choice, but notes that the OpenRouter embeddings API returns floats; the sample therefore uses 1,024-dimensional floats and an in-memory NumPy store. For production, the post suggests replacing that store with a vector database such as pgvector, Qdrant, Pinecone, or Weaviate.

For each question, the example embeds the query with `cohere/embed-5-fast`, retrieves 20 candidates by cosine similarity, and sends them to `cohere/rerank-5-pro`. The reranker reads the query alongside each candidate and returns a ranked list; the script keeps up to five results above a relevance threshold of 0.3. Cohere says Embed 5 Pro and Fast share an embedding space, so a Pro-built index can be queried with Fast as long as dimensions match. In Cohere’s tests across 40 datasets, Fast queries against a Pro index retained 98.4% of all-Pro retrieval quality; Fast on both sides retained 96.6%. Those are Cohere-reported results, not independent benchmark findings.

The post says embedding cost is per token and distinguishes the one-time indexing job from per-question calls: one Embed 5 Fast call, one Rerank 5 call, and one chat call. Embed 5 accepts up to 128,000 tokens; Rerank 5 reads up to 32,000 tokens of query and chunk combined, splitting longer inputs into multiple passes. Rerank can also be used without Cohere embeddings, as a second stage after semantic, keyword, or hybrid search. The supplied article excerpt does not provide OpenRouter prices or additional account limits.

## What the archive adds
This is a new availability detail on a known Cohere retrieval story. [Cohere Rerank 5 | More Relevant Context for RAG and Agents](https://newruntime.com/posts/cohere-rerank-5-more-relevant-context-for-rag-bba6d4/) covered the model launch, while [Shared vs. Dedicated AI Inference: Embed & Rerank](https://newruntime.com/posts/shared-vs-dedicated-ai-inference-embed-rerank-analysis-4756e4/) examined inference economics. The new fact is that both model families can now be called through OpenRouter, alongside a concrete integration example.

## Trend signal
This modestly supports [agent protocols become the interoperability layer](https://newruntime.com/patterns/agent-protocols-become-interoperability-layer/): a shared API surface can let builders combine provider models without adopting a separate integration for each. The evidence is limited to one gateway and two retrieval model families; it does not establish a broader protocol standard or prove that this route is cheaper or more reliable.

## Why now
The stated timing is an availability announcement: Cohere says both model families are live on OpenRouter, and that existing OpenRouter users can begin with their current key and credits. The post does not explain the commercial or technical reason for the timing, so there is no basis to infer a broader market trigger.

## Connections to other events
An earlier Cohere post covered the choice between shared and dedicated inference for Embed and Rerank, and a later archive note covers Rerank 5’s arrival. This OpenRouter integration connects the models’ serving economics and retrieval role to a gateway-based implementation path. It does not change the archive’s earlier claims about deployment choices, and the supplied material gives no evidence of a partnership beyond this availability.

## Why it matters
For a team already using OpenRouter, the integration can reduce setup friction: the example reuses its key and credits and avoids adding a separate SDK. More importantly, it gives builders a testable retrieval design rather than requiring them to choose a single model for every stage. Indexing is an occasional batch operation, so a quality-oriented Pro model can build the corpus; query embedding happens on every search, so Fast can be evaluated there for latency. Reranking then spends additional inference on a shortlist rather than the whole collection.

The reported 98.4% result gives teams a specific hypothesis to test, not a guarantee of their own retrieval quality. Document types, language, chunking, query distribution, and latency requirements can alter the trade-off. Builders should run a representative evaluation and measure answer grounding, retrieval recall, end-to-end latency, and total cost per successful question. The article’s use of OpenRouter is an implementation option, not evidence that it will outperform direct Cohere access or another gateway.

## Limits and uncertainty
The performance percentages come from Cohere’s own tests across 40 datasets; the post excerpt provides no dataset list, independent replication, confidence intervals, or task-level breakdown. It does not establish that the Pro/Fast split works equally well for every corpus or language. The sample uses an in-memory vector store and fictional API documentation, so it is not a production deployment result. The supplied material also gives no current prices, throughput guarantees, service-level commitments, or account-specific access limits on OpenRouter. Calibrated scores are presented as a model feature, but the article does not quantify how well a threshold transfers to a particular application.

## Skill to build now
Build a small retrieval evaluation set from real questions your product must answer, each paired with the relevant source passage. Compare Pro embeddings on both indexing and query with a Pro-index/Fast-query setup at matching dimensions; then test Rerank 5 on the same candidate pool. Track whether the correct passage appears in the top five, whether the final answer cites it, latency, and measured spend. This makes Cohere’s reported trade-off actionable without treating it as a result your data has already earned.

## Reader takeaway
OpenRouter now offers a single-key path to Cohere Embed 5 and Rerank 5, with a practical recipe for a two-stage RAG pipeline. The most interesting claim is that Fast queries can work against a Pro-built index with little reported retrieval-quality loss. Treat that as a benchmark hypothesis: validate it on your corpus, and price the complete per-question path before switching.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Models](https://newruntime.com/topics/models.md): Explore the models topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Sources](https://newruntime.com/sources/): See the original sources this archive cites.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)