---
type: "post"
id: "apache-2-0-licensed-onnx-available-with-a-404ae2"
slug: "apache-2-0-licensed-onnx-available-with-a-404ae2"
title: "Apache-2.0 licensed, ONNX available, with a 34M small variant also released."
description: "DeepVK has published USER2-small, a 34-million-parameter Russian sentence encoder under Apache 2.0."
retrieval_nugget: "DeepVK has published USER2-small, a 34-million-parameter Russian sentence encoder under Apache 2.0. It offers an 8,192-token context window, selectable embedding dimensions, and documented retrieval-oriented usage, giving teams a compact checkpoint to evaluate for Russian semantic search and RAG pipelines rather than a general-purpose chat model."
published_at: "2026-10-27"
updated_at: "2026-10-27"
record_date: "2026-10-27"
date_kind: "published_at"
topics: ["open-models","models"]
entities: ["DeepVK","USER2-small","USER2-base","RuModernBERT-small","Hugging Face","MTEB-rus","MultiLongDocRetrieval"]
related_patterns: []
novelty_label: "new_fact"
what_changed: "DeepVK released USER2-small, a 34M-parameter Russian sentence-embedding model with Apache-2.0 licensing and ONNX availability."
prior_refs: []
source_url: "https://huggingface.co/deepvk/USER2-small"
source_urls: ["https://huggingface.co/deepvk/USER2-small"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:apache-2-0-licensed-onnx-available-with-a-404ae2"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/apache-2-0-licensed-onnx-available-with-a-404ae2/","markdown":"https://newruntime.com/posts/apache-2-0-licensed-onnx-available-with-a-404ae2.md","json":"https://newruntime.com/posts/apache-2-0-licensed-onnx-available-with-a-404ae2.json"}
---

# Apache-2.0 licensed, ONNX available, with a 34M small variant also released.

## Retrieval answer

DeepVK has published USER2-small, a 34-million-parameter Russian sentence encoder under Apache 2.0. It offers an 8,192-token context window, selectable embedding dimensions, and documented retrieval-oriented usage, giving teams a compact checkpoint to evaluate for Russian semantic search and RAG pipelines rather than a general-purpose chat model.

## Summary

DeepVK has published USER2-small, a 34-million-parameter Russian sentence encoder under Apache 2.0. It offers an 8,192-token context window, selectable embedding dimensions, and documented retrieval-oriented usage, giving teams a compact checkpoint to evaluate for Russian semantic search and RAG pipelines rather than a general-purpose chat model.

## What happened

DeepVK published `deepvk/USER2-small` on Hugging Face as a small version of USER2, described as a new generation of the Universal Sentence Encoder for Russian. The model card positions USER2 as a sentence-representation model for retrieval and semantic tasks. USER2-small has 34 million parameters, a hidden dimension of 384, and support for inputs up to 8,192 tokens. The release is licensed under Apache 2.0.

The checkpoint is built on RuModernBERT-small. According to the model card, it was fine-tuned in three stages: RetroMAE, weakly supervised fine-tuning, and supervised fine-tuning. DeepVK says the RetroMAE stage is a retrieval-oriented continuous-pretraining step intended to improve long-context retrieval. Its weak-supervision description combines English and Russian data, including in-house English-Russian parallel corpora, and says the team mined 50 million text pairs from the `deepvk/cultura_ru_edu` corpus using non-overlapping blocks of text.

A central deployment feature is Matryoshka Representation Learning. USER2-small produces 384-dimensional representations, but the card says it was trained at dimensions 32, 64, 128, 256, and 384. Users can set `truncate_dim` when loading the model with Sentence Transformers, with the supplied example using 128 dimensions. That makes one checkpoint usable for experiments with smaller vector indexes and lower storage or retrieval costs. The authors recommend selecting one of the trained dimensions rather than an arbitrary truncation point.

The card also specifies task prefixes. `classification:` is presented as a general default; `clustering:` is recommended for grouping texts, topic discovery, or deduplication; and `search_query:` plus `search_document:` are intended for retrieval and reranking. The included examples load the checkpoint through Sentence Transformers, encode a query and a document with the respective search prefixes, and compare the resulting embeddings. A separate Transformers example mean-pools token embeddings, normalizes them, and computes similarity with a matrix multiplication.

DeepVK reports results on MTEB-rus and on the Russian subset of MultiLongDocRetrieval. On MTEB-rus, USER2-small reports a mean task score of 58.32 and a mean task-type score of 56.68. Its reported retrieval score is 61.87, while its semantic textual similarity score is 72.25. On MLDR-rus, where the card compares only models with an 8,192-token context length, USER2-small reports nDCG@10 of 51.69. The larger USER2-base is also listed at 149 million parameters, 768 hidden dimensions, and the same 8,192-token context length.

## What the archive adds

This is a new event rather than a new fact in an existing DeepVK story. Our note on [OpenBMB's MiniCPM-V 4.7 1B](https://newruntime.com/posts/openbmb-released-minicpm-v-4-7-1b-an-6db742/) covered a small, openly distributed checkpoint with concrete local-deployment details. USER2-small extends that practical release pattern into Russian-language embeddings and retrieval.

## Trend signal

No supplied New Runtime pattern directly fits this release. It is evidence of a compact, permissively licensed model becoming easier to evaluate and integrate locally, but the supplied material does not establish a broader change in agent economics, interoperability, security, or organizational practice.

## Why it matters

For a team building Russian-language search, retrieval-augmented generation, document matching, clustering, or deduplication, an embedding model is infrastructure: it determines what gets retrieved before a generative model ever sees context. USER2-small offers a compact option with a documented long-context limit and an explicit query/document encoding convention. Its trained truncation sizes may let a team test index-size and latency trade-offs without changing the underlying checkpoint.

The important operational qualification is that a benchmark number is not a deployment guarantee. A retrieval stack depends on corpus structure, chunking, query formulation, vector-store settings, prefix discipline, and relevance evaluation. Still, publishing the expected prefixes, dimensions, loading paths, and reported Russian benchmarks turns the release into something a practitioner can test rather than merely a model name to track.

## Limits and uncertainty

The release page reports benchmark outcomes from its authors; it does not provide an independent evaluation of the model in a particular production corpus. The supplied material does not establish inference latency, memory consumption, throughput, ONNX performance, hardware requirements, multilingual behavior, or commercial support. It also does not show how USER2-small compares on a team's own queries, documents, chunking scheme, or relevance labels. The reported MTEB-rus and MLDR-rus figures should therefore be treated as selection evidence for an evaluation shortlist, not proof that it will outperform alternatives in a deployed RAG system.

## Skill to build now

Run a small retrieval bake-off on a representative Russian corpus. Index the same documents with USER2-small at 384 and 128 dimensions, use `search_query:` for queries and `search_document:` for documents, then score a fixed set of human-judged queries for recall and ranking quality. Record index size, retrieval latency, and failures alongside relevance. That experiment tests the model card's most actionable claim: whether trained dimensional truncation preserves enough quality for the operational savings it may offer.

## Reader takeaway

USER2-small is a 34M-parameter, Apache-2.0 Russian embedding checkpoint with 8K context and selectable trained embedding sizes. Its value is not that it replaces a chat model; it gives Russian retrieval builders a specific, documented model to benchmark for search and RAG, with index-footprint trade-offs built into the release.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Open Models](https://newruntime.com/topics/open-models.md): Explore the open-models topic hub.
- topic hub: [Models](https://newruntime.com/topics/models.md): Explore the models topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)