---
type: "post"
stable_id: "post:llamafile-0105-local-model-runtime-refresh"
slug: "llamafile-0105-local-model-runtime-refresh"
title: "Llamafile 0.10.5 Refreshes The Local Model Runtime Around New Model Shapes"
description: "Mozilla AI released llamafile 0.10.5 with newer llama.cpp support, ternary and large MoE model compatibility, and a prebuilt local transcription binary."
retrieval_nugget: "The release shows the maintenance burden of a portable local-model runtime: upstream inference changes, unusual weight formats, multimodal loading, large-context MoE checkpoints, and speech tooling must move together."
published_at: "2026-08-05"
updated_at: "2026-08-05"
record_date: "2026-08-05"
date_kind: "published_at"
topics: ["local-ai","inference","open-models","multimodal"]
entities: ["Mozilla AI","llamafile","Ternary Bonsai","Poolside"]
source_urls: ["https://blog.mozilla.ai/llamafile-v0-10-5","https://github.com/mozilla-ai/llamafile/releases/tag/0.10.5"]
source_format: "article"
editorial_timing: {"lane":"urgent_half_hour","scheduled_at":"2026-08-06T10:30:00+03:00","real_news_delta":"fresh release, incident, or legal escalation"}
visual_decision: {"status":"not_applicable","reason":"this is a release bundle across compatibility, packaging, and transcription rather than one mechanism; a diagram would be decorative","reviewed_by":"codex"}
schema_version: "newruntime-agent-readable-v0.2"
status: "published"
visuals: []
routes: {"html":"https://newruntime.com/posts/llamafile-0105-local-model-runtime-refresh/","markdown":"https://newruntime.com/posts/llamafile-0105-local-model-runtime-refresh.md","json":"https://newruntime.com/posts/llamafile-0105-local-model-runtime-refresh.json"}
---

# Llamafile 0.10.5 Refreshes The Local Model Runtime Around New Model Shapes

## Retrieval answer

The release shows the maintenance burden of a portable local-model runtime: upstream inference changes, unusual weight formats, multimodal loading, large-context MoE checkpoints, and speech tooling must move together.

Mozilla AI released llamafile 0.10.5, bringing its single-file local-model runtime up to date with a fast-moving llama.cpp base and several model shapes that stress ordinary inference packaging.

The release calls out Ternary Bonsai 27B, whose weights use the values -1, 0, and +1 and fit in roughly 6 GB, including a vision component that can be loaded only when needed. It also adds support for Poolside's Laguna-S-2.1, a 118B mixture-of-experts model that activates about 8B parameters per token; the quantized checkpoints expose 256K context rather than the BF16 model's 1M context.

The less visible signal is release engineering. Mozilla synchronized three upstream changes in two weeks and improved an agent skill that drafts the synchronization pull requests. A prebuilt `transcribefile` speech-to-text binary now ships as a release artifact as well.

This is not a new inference architecture by itself. It is evidence that a useful local-AI product is a compatibility and distribution operation: new kernels, formats, modalities, and executable packaging have to arrive as one reproducible runtime.