Field noteOct 26, 20261 min read1 source

Community MLX quant fits Nanbeige4.3-33B into 15.7 GiB for 24 GB Apple Silicon Macs

In one minute

Hugging Face user alexwengg has published Nanbeige4.3-33B-MLX-mixed-3-4-6bit, an MLX quantization of the Apache 2.0 Nanbeige4.3-33B model.

What changed: A community MLX quantization of Nanbeige4.3-33B is said to fit in 15.7 GiB for 24 GB Apple Silicon Macs; prior MLX release coverage concerned Qwen3.8-27B.

The repository is public, ungated, tagged for MLX and Apple Silicon, and lists a total size of 15.7 GiB.

The mixed layout uses 3-bit weights for MLP gate and up projections, 4-bit weights for attention, down_proj, and embeddings, and 6-bit weights for lm_head. The author says it was made from BF16 weights and can be served with mlx_lm.server as an OpenAI-compatible endpoint.

In the repository description, the author reports roughly 15-16.5 decode tokens per second and about 17 GB peak memory on an M5 Pro with 24 GB of memory. They also report seven passes from eight LeetCode-style smoke tests and a sandboxed terminal-agent run that fixed three bugs in a small repository.

The page does not provide independent benchmarks, reproducible test artifacts, comparisons under controlled settings, or evidence that the reported agent result generalizes beyond the stated small repository.

Evidence / sources

  1. 1huggingface.co/alexwengg/Nanbeige4.3-33B-MLX-mixed-3-4-6bit
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicLocal ModelsExplore the local-models topic hub.
  2. 02topicModelsExplore the models topic hub.
  3. 03topicInferenceExplore the inference topic hub.
  4. 04archiveField NotesOpen the latest editorial analysis.
  5. 05source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract