---
type: "post"
id: "bytedance-seed-published-model-weights-on-hugging-face-8029c4"
slug: "bytedance-seed-published-model-weights-on-hugging-face-8029c4"
title: "ByteDance Seed published model weights on Hugging Face: Cola2"
description: "ByteDance Seed has made Cola2 available as a public model repository on Hugging Face, with sharded Safetensors weights and instructions for loading it through Transformers or serving it with vLLM."
retrieval_nugget: "ByteDance Seed has made Cola2 available as a public model repository on Hugging Face, with sharded Safetensors weights and instructions for loading it through Transformers or serving it with vLLM. The release gives builders a concrete route to inspect and run the model, but the supplied repository material does not establish how its capabilities compare with alternatives."
published_at: "2026-11-06"
updated_at: "2026-11-06"
record_date: "2026-11-06"
date_kind: "published_at"
topics: ["open-models","models","inference"]
entities: ["ByteDance Seed","Cola2","Hugging Face","Transformers","vLLM"]
related_patterns: []
novelty_label: "new_fact"
what_changed: "ByteDance Seed published Cola2 weights on Hugging Face, a distinct model release from the other archived Hugging Face releases."
prior_refs: ["https://newruntime.com/posts/only-18-mb-of-onnx-weights-no-pytorch-61535a/","https://newruntime.com/posts/moonshot-ai-released-full-open-weights-for-kimi-8c09c3/"]
source_url: "https://huggingface.co/ByteDance-Seed/Cola2"
source_urls: ["https://huggingface.co/ByteDance-Seed/Cola2"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:bytedance-seed-published-model-weights-on-hugging-face-8029c4"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/bytedance-seed-published-model-weights-on-hugging-face-8029c4/","markdown":"https://newruntime.com/posts/bytedance-seed-published-model-weights-on-hugging-face-8029c4.md","json":"https://newruntime.com/posts/bytedance-seed-published-model-weights-on-hugging-face-8029c4.json"}
markdown_url: "https://newruntime.com/posts/bytedance-seed-published-model-weights-on-hugging-face-8029c4.md"
---

# ByteDance Seed published model weights on Hugging Face: Cola2

## Retrieval answer

ByteDance Seed has made Cola2 available as a public model repository on Hugging Face, with sharded Safetensors weights and instructions for loading it through Transformers or serving it with vLLM. The release gives builders a concrete route to inspect and run the model, but the supplied repository material does not establish how its capabilities compare with alternatives.

## Summary
ByteDance Seed has made Cola2 available as a public model repository on Hugging Face, with sharded Safetensors weights and instructions for loading it through Transformers or serving it with vLLM. The release gives builders a concrete route to inspect and run the model, but the supplied repository material does not establish how its capabilities compare with alternatives.

## What happened
The ByteDance-Seed/Cola2 repository is public on Hugging Face and is not marked as gated. Its metadata identifies it as a Transformers model with text-generation and conversational tags; the model configuration also lists feature extraction. The repository includes custom code, and the Transformers instructions use `trust_remote_code=True` when loading it. That is a relevant implementation detail for teams evaluating the release: the provided loading path explicitly trusts repository code rather than relying only on standard model classes.

The repository reports 8,768,019,912 parameters, stored in sharded Safetensors files, with a total file size of 35,072,298,172 bytes. The listing does not present quantized weights: its metadata says `isQuantized` is false and that no quantizations are available. A team planning a local evaluation should therefore account for a sizeable download and the hardware and memory requirements of running an approximately 8.8-billion-parameter model; the repository excerpt does not specify a minimum hardware configuration.

For Transformers, the page shows a high-level `pipeline("text-generation", model="ByteDance-Seed/Cola2", trust_remote_code=True)` example and a direct `AutoModel.from_pretrained` example with `device_map="auto"`. It says to install or upgrade `transformers` and `accelerate`. The examples provide a short conversational prompt and a simple question, but they are usage snippets, not evaluation results. The card also documents a vLLM route: install vLLM, start `vllm serve "ByteDance-Seed/Cola2"`, then call the server through an OpenAI-compatible `/v1/chat/completions` endpoint. A Docker command is also shown for running the model. The supplied material does not state a price for hosted inference, a license, a service-level commitment, or a supported context length.

The Hugging Face tags link the repository to the paper titled “Cola2: Co-Adaptive Hierarchical Language Modeling with Continuous Semantic Compression and Balanced Discrete Generation” and identify it with an arXiv reference. Those title terms signal the research framing, but the material provided here does not include the paper's abstract, methods, experiments, or results. It therefore supports describing the repository and its documented usage, not making claims about what the architecture achieves or whether it outperforms another model.

## What the archive adds
This is a new model-weight release, distinct from the archive's earlier coverage of [Moonshot AI's full open weights for Kimi K3.1 Pro](https://newruntime.com/posts/moonshot-ai-released-full-open-weights-for-kimi-8c09c3/). That earlier note concerns another model's weights on Hugging Face; it does not establish a prior Cola2 announcement or a connection between the models. The archive also covered a small ONNX OCR package, but that is not materially the same release. For Cola2, the current repository is a new event rather than a new fact on a known Cola2 story.

## Trend signal
The repository provides a concrete example of model weights being made directly runnable through several community tooling paths, but one release is not enough to support a broader trend claim. None of the supplied SITE_PATTERNS directly addresses open-weight model publication or model-specific deployment instructions, so no pattern link is warranted.

## Why it matters
For a team that wants to test an open model rather than call a hosted endpoint, the useful part of this release is the combination of publicly accessible weights and explicit loading and serving examples. The vLLM route, in particular, identifies a way to expose a local server using an OpenAI-compatible chat-completions endpoint. That gives engineers a starting point for a controlled integration test without implying that the model is a drop-in production substitute.

The operational cost is also visible before a test begins: the repository lists roughly 35 GB of weights and nearly 8.8 billion parameters, with no quantized version noted in the supplied metadata. Teams can use those facts to decide whether to allocate storage and suitable hardware for an evaluation. The custom-code requirement matters as well; a responsible evaluation should review the repository code and deployment environment before granting it trust. The source does not provide quality, latency, or cost measurements, so those remain items for a team's own test rather than assumptions to carry into product planning.

## Limits and uncertainty
The supplied repository view verifies the existence, public access status, tags, weight format and size, and example usage paths. It does not provide the model card's substantive technical description, the linked paper's experimental results, benchmark comparisons, or independent evaluation. It also does not establish a license, minimum hardware, context limit, safety properties, training-data details, or whether any hosted inference option is available. The snippets show intended usage, not that the examples were independently tested here. As a result, no claim about accuracy, reliability, efficiency, or suitability for a particular production task follows from this evidence alone.

## Reader takeaway
Cola2 is publicly downloadable on Hugging Face and has documented Transformers and vLLM usage paths, but its listed weights are large and the provided evidence contains no performance results. Treat the release as an invitation to inspect and evaluate the model, not as evidence that it is better, cheaper, or production-ready. Review the custom code and verify the license and hardware needs before adoption.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Open Models](https://newruntime.com/topics/open-models.md): Explore the open-models topic hub.
- topic hub: [Models](https://newruntime.com/topics/models.md): Explore the models topic hub.
- topic hub: [Inference](https://newruntime.com/topics/inference.md): Explore the inference topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Sources](https://newruntime.com/sources/): See the original sources this archive cites.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)