---
type: "post"
id: "datologyai-open-sources-zephon-an-elastically-deterministic-data-1c88d9"
slug: "datologyai-open-sources-zephon-an-elastically-deterministic-data-1c88d9"
title: "DatologyAI open-sources Zephon, an elastically deterministic data loader for foundation-model training"
description: "DatologyAI has open-sourced Zephon, a data loader for text and multimodal foundation-model training."
retrieval_nugget: "DatologyAI has open-sourced Zephon, a data loader for text and multimodal foundation-model training."
published_at: "2026-10-23"
updated_at: "2026-10-23"
record_date: "2026-10-23"
date_kind: "published_at"
topics: ["multimodal"]
entities: ["DatologyAI","Zephon","TorchTitan","Megatron-LM","FineWeb","DCLM Core v1"]
related_patterns: []
novelty_label: "same_event"
what_changed: "Same event as GitHub - datologyai/zephon: Fast, flexible, elastically deterministic data loading for foundation model training"
prior_refs: ["memory:9a26accb-9e96-865a-a551-713ca90298ba"]
source_url: "https://www.datologyai.com/blog/zephon"
source_urls: ["https://www.datologyai.com/blog/zephon"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:datologyai-open-sources-zephon-an-elastically-deterministic-data-1c88d9"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/datologyai-open-sources-zephon-an-elastically-deterministic-data-1c88d9/","markdown":"https://newruntime.com/posts/datologyai-open-sources-zephon-an-elastically-deterministic-data-1c88d9.md","json":"https://newruntime.com/posts/datologyai-open-sources-zephon-an-elastically-deterministic-data-1c88d9.json"}
---

# DatologyAI open-sources Zephon, an elastically deterministic data loader for foundation-model training

## Retrieval answer

DatologyAI has open-sourced Zephon, a data loader for text and multimodal foundation-model training.

DatologyAI has open-sourced Zephon, a data loader for text and multimodal foundation-model training. The company says Zephon preserves the same sequence of global training batches when GPU count, operator parallelism, or execution backend changes, including pipelines that tokenize, pack, and mix data during training.

The release targets resumed jobs and cluster resizing, where a conventional loader can change the samples seen after a checkpoint. DatologyAI reports an experiment training a 1B-parameter model for 20B tokens on 8 to 64 GPUs: FineWeb evaluation scores varied by up to 0.64 points with a standard loader and 0.011 with Zephon. Reported DCLM Core v1 variation was 0.82 and 0.05 points, respectively.

DatologyAI also reports 16,000 samples per second for fetch-and-batch, versus 5,800 for Grain, and provides a paper, documentation, and integrations for TorchTitan and Megatron-LM. The source does not establish independent reproduction of the performance or evaluation results, nor does it show how Zephon performs across other training stacks or workloads.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Multimodal](https://newruntime.com/topics/multimodal.md): Explore the multimodal topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)