Field noteOct 27, 20261 min read1 source

Slotstream runs a 125B MoE model on 16 to 64 GB Macs by streaming experts from SSD.

In one minute

Slotstream is a public GitHub project for running Qwen3.8-Flash-Next in a 4-bit configuration on Apple Silicon Macs by streaming model experts from SSD rather than keeping the full model in memory.

What changed: Slotstream adds a Mac-specific SSD-streaming approach, claiming to run a 125B MoE model on 16–64 GB Apple Silicon Macs; prior items describe SSD-offloaded MoE inference on Edge0 or NVIDIA rigs.

The repository describes the target as a 105 GB AI model on Macs with 16 GB to 64 GB of memory. It is written in native Swift and uses MLX and Metal; the project says it can run offline, without Python. The repository also lists a CLI and a Swift library.

The source frames the approach around mixture-of-experts inference, where experts can be loaded from SSD as needed. It does not establish independent throughput, latency, quality, SSD-wear, stability, or results across the stated Mac memory configurations. It also does not, in the supplied material, provide a comparative benchmark against other local runtimes.

Evidence / sources

  1. 1github.com/carloslfu/slotstream
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicGithubExplore the github topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract