---
type: "raw_signal"
id: "amazon-science-reports-a-method-called-priming-that-9bd2cc"
slug: "amazon-science-reports-a-method-called-priming-that-9bd2cc"
title: "Amazon Science reports a method called priming that reuses pretrained Transformer weights to construct hybrid"
description: "Amazon Science reports a method called priming that reuses pretrained Transformer weights to construct hybrid architectures, aiming to reduce the cost of pretraining more efficient models."
retrieval_nugget: "Amazon Science reports a method called priming that reuses pretrained Transformer weights to construct hybrid architectures, aiming to reduce the cost of pretraining more efficient models."
observed_at: "2026-10-13"
record_date: "2026-10-13"
date_kind: "observed_at"
why_it_matters: "The reported 32-billion-parameter Gated KalmaNet-based hybrid matched its source Transformer on reasoning benchmarks and decoded up to twice as quickly with a 128,000-token context. The article also says state-space models outperformed sliding-window attention in its comparisons, including when the latter had twice the memory budget. These are results described in Amazon Science’s account; the rep"
novelty: "notable"
verification_level: "source-linked"
signal_type: "research"
source_platform: "amazon.science"
topics: []
entities: ["Amazon","Amazon Science","Gated KalmaNet"]
related_patterns: []
source_url: "https://www.amazon.science/blog/can-we-change-an-ai-models-architecture-without-retraining-it-from-scratch"
source_urls: ["https://www.amazon.science/blog/can-we-change-an-ai-models-architecture-without-retraining-it-from-scratch"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "signal:amazon-science-reports-a-method-called-priming-that-9bd2cc"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/signals/amazon-science-reports-a-method-called-priming-that-9bd2cc/","markdown":"https://newruntime.com/signals/amazon-science-reports-a-method-called-priming-that-9bd2cc.md","json":"https://newruntime.com/signals/amazon-science-reports-a-method-called-priming-that-9bd2cc.json"}
---

# Amazon Science reports a method called priming that reuses pretrained Transformer weights to construct hybrid

## Retrieval answer

Amazon Science reports a method called priming that reuses pretrained Transformer weights to construct hybrid architectures, aiming to reduce the cost of pretraining more efficient models.

Amazon Science reports a method called priming that reuses pretrained Transformer weights to construct hybrid architectures, aiming to reduce the cost of pretraining more efficient models. The article says the approach cuts that cost to less than 1% of the original training cost and reports savings equivalent to trillions of tokens and hundreds of thousands of GPU-hours.

The reported 32-billion-parameter Gated KalmaNet-based hybrid matched its source Transformer on reasoning benchmarks and decoded up to twice as quickly with a 128,000-token context. The article also says state-space models outperformed sliding-window attention in its comparisons, including when the latter had twice the memory budget. These are results described in Amazon Science’s account; the report does not establish independent replication or production performance.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- collection: [Raw Signals](https://newruntime.com/signals.json): Open every source-linked raw signal.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)