---
type: "post"
id: "orcarouter-launches-orca-connect-letting-local-gpu-models-fa1c6b"
slug: "orcarouter-launches-orca-connect-letting-local-gpu-models-fa1c6b"
title: "OrcaRouter launches Orca Connect, letting local GPU models such as OrcaCyber Nano be served through the OrcaRouter API"
description: "FlashLabs has launched Orca Connect for the OrcaRouter inference gateway."
retrieval_nugget: "FlashLabs has launched Orca Connect for the OrcaRouter inference gateway."
published_at: "2026-10-28"
updated_at: "2026-10-28"
record_date: "2026-10-28"
date_kind: "published_at"
topics: ["claude","claude-code","codex"]
entities: ["FlashLabs","OrcaRouter","Orca Connect","Continuum AI","Ollama","Claude Code","Codex CLI"]
related_patterns: ["harness-architecture-outlives-model-choice"]
novelty_label: "new_fact"
what_changed: "OrcaRouter now offers Orca Connect to serve local models such as OrcaCyber Nano 1.0 through its API without inbound port or tunnel setup."
prior_refs: ["memory:11b83958-5a06-8ca2-ab45-7e1cb800faa0","memory:8a74dee8-f853-8961-a5ef-aea5fde66137"]
source_url: "https://prtimes.jp/main/html/rd/p/000000120.000138449.html"
source_urls: ["https://prtimes.jp/main/html/rd/p/000000120.000138449.html"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:orcarouter-launches-orca-connect-letting-local-gpu-models-fa1c6b"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/orcarouter-launches-orca-connect-letting-local-gpu-models-fa1c6b/","markdown":"https://newruntime.com/posts/orcarouter-launches-orca-connect-letting-local-gpu-models-fa1c6b.md","json":"https://newruntime.com/posts/orcarouter-launches-orca-connect-letting-local-gpu-models-fa1c6b.json"}
---

# OrcaRouter launches Orca Connect, letting local GPU models such as OrcaCyber Nano be served through the OrcaRouter API

## Retrieval answer

FlashLabs has launched Orca Connect for the OrcaRouter inference gateway.

## Summary
FlashLabs has launched Orca Connect for the OrcaRouter inference gateway. The connector exposes models running on a developer’s own GPU through the same API surface as hosted models, with optional fallback to a hosted model when the local machine cannot serve a request.

For teams experimenting with local inference, the release is notable less for a new model than for the operating boundary it proposes: local and hosted capacity can sit behind one endpoint, one catalog, and controlled sharing rules.

## What happened
On October 27, 2026, FlashLabs announced Orca Connect, a new feature for OrcaRouter, the inference gateway it exclusively provides for the Japanese market. According to the announcement, OrcaRouter was developed by Continuum AI and offers an OpenAI-compatible API across more than 200 LLM and generative-AI models. Orca Connect extends that gateway to models a user is already running on their own machine.

The connector supports six local inference runtimes: Ollama, vLLM, LM Studio, llama.cpp, SGLang, and NVIDIA TensorRT-LLM. Once installed and authorized, it detects local runtimes and models; an operator chooses which models to expose and starts the service with `orca-connect serve`. The selected model then appears in the OrcaRouter catalog under a name in the form `local/machine-name/model-name`. Other devices and cloud-based agents can call it through the usual OrcaRouter API key.

The network design described in the release uses one outbound connection from the machine running the connector. FlashLabs says this removes the need to open inbound router or firewall ports, configure a tunnel, or handle NAT traversal. Requests are carried as individual streams, and the company says nothing is exposed until an operator explicitly selects a model to share. The release also describes expiring, request-limited sharing links. Recipients sign in to their own accounts rather than receiving the operator’s key, and links can be revoked.

Pricing is split by where the response is served. Responses produced on the user’s own hardware are marked `X-Orca-Billed: false` and recorded as zero dollars, according to the announcement. Hosted-model responses are billed normally. An optional spillover feature can send a request to a specified hosted model if the local machine is offline or busy, the prompt is too long, the runtime fails, or the request requires tools. Spillover is off by default, has a monthly limit, and returns a reason plus an estimated cost. A reverse-spillover option can retain a hosted-model name in application code while using a mapped local model whenever it is available.

FlashLabs also says Orca Connect can launch ten coding agents against a local model with a command such as `orca-connect claude`; listed examples include Claude Code, Codex CLI, OpenCode, Gemini CLI, Qwen Code, Kimi Code, Copilot CLI, Aider, Goose, and pi. The release says the agent’s own configuration is not changed. It further claims encrypted relay transport and Zero Data Retention on all plans, while saying users can bypass the relay with Tailscale or WireGuard for a fully private connection.

## What the archive adds
This is a new fact on a known OrcaRouter story. A prior Field Note covered the gateway’s positioning of OrcaCyber Zero 1.5 as a local counterpart to a hosted model: [Positioned as local counterpart to hosted OrcaCyber Zero 1.5 on the OrcaRouter gateway](https://newruntime.com/posts/positioned-as-local-counterpart-to-hosted-orcacyber-zero-2f993d/). Orca Connect adds the delivery mechanism: a local runtime can now be surfaced through the gateway’s catalog and API rather than merely described as a local option.

## Trend signal
The release supports the pattern that [harness architecture outlives model choice](https://newruntime.com/patterns/harness-architecture-outlives-model-choice/). Orca Connect keeps an application-facing API, API key, catalog naming scheme, and fallback policy stable while the serving model may be local or hosted. That does not prove the architecture is durable, but it is a concrete example of moving deployment choice below the interface used by agents and applications.

## Connections to other events
A separate Field Note reported that GitHub Copilot CLI can discover supported models from a running local Ollama instance: [Discover local models in GitHub Copilot CLI](https://newruntime.com/posts/discover-local-models-in-github-copilot-cli-1b8ee0/). That feature discovers local capacity from the client side. Orca Connect instead makes selected local capacity addressable through a gateway and adds optional hosted fallback, sharing controls, and a common API route.

## Why it matters
Running a model locally is straightforward compared with making it dependable for a team, a remote developer, or an agent running in the cloud. Teams usually have to solve reachability, credentials, selection, fallback, and usage visibility separately. Orca Connect packages those concerns behind a gateway contract: a request can target a local model name, remain local-only, or move to an explicitly allowed hosted model under defined conditions.

The practical consequence is not that local inference becomes free or universally private. Hardware, operations, model quality, and the relay path still matter. But a team can evaluate local models without forcing every calling application or coding agent to learn a different endpoint and connection method. The reverse-spillover option is especially relevant to gradual migration: existing code can retain a hosted-model identifier while local capacity serves eligible work when it is online.

## Limits and uncertainty
This account is based on FlashLabs’ launch announcement, including claims attributed to OrcaRouter documentation and its social-media announcement. It does not independently verify relay implementation, retention behavior, encryption properties, agent compatibility, performance, or the scope of the stated Zero Data Retention policy. The announcement gives no benchmark data for latency, throughput, reliability, or model quality, and no price schedule for hosted spillover. It also does not establish whether OrcaRouter or Orca Connect is available outside the distributor’s Japanese-market offering. Teams should test failure behavior and data handling before routing sensitive production work through it.

## Skill to build now
Write a small routing contract for one internal AI workflow. Define the local model identifier, the conditions under which hosted fallback is permitted, a monthly fallback budget, and which requests must never leave local infrastructure. Then test four cases: healthy local service, offline machine, overloaded machine, and an overlong request. The useful outcome is not merely a connector installation; it is an auditable answer to who may change the execution location and when.

## Reader takeaway
Orca Connect turns a locally running model into a named API target within OrcaRouter, without requiring inbound port exposure according to its maker. Its more consequential feature is controlled choice: local capacity can be primary while a hosted model remains an explicit, metered fallback rather than a separate integration path.

## Open question
Will the connector’s relay and fallback controls provide enough observable policy and reliability data for teams to use local GPUs as production capacity, rather than only as a development convenience?

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Claude](https://newruntime.com/topics/claude.md): Explore the claude topic hub.
- topic hub: [Claude Code](https://newruntime.com/topics/claude-code.md): Explore the claude-code topic hub.
- topic hub: [Codex](https://newruntime.com/topics/codex.md): Explore the codex topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)