Field noteOct 27, 20261 min read1 source

Unsloth ships Dynamic 3.0 GGUF quants of MiniMax-M3.1-Flash for local Desktop and llama.cpp runs

In one minute

Unsloth has published Dynamic 3.0 GGUF quantizations for MiniMax-M3.1-Flash, a 428B-parameter mixture-of-experts multimodal model with 23B active parameters and a stated 1M-token context.

What changed: Unsloth adds Dynamic 3.0 GGUF quantizations for local Desktop and llama.cpp runs, with quant sizes, benchmark results, and hardware requirements.

The files can be run locally through Unsloth Desktop or a compatible llama.cpp build, and are available from the unsloth/MiniMax-M3.1-Flash-GGUF repository.

The documented variants range from the 129.4 GB UD-IQ1_M file to the 259.1 GB UD-Q8_K_XL file. For a 16K text context and one parallel slot, Unsloth estimates combined RAM and VRAM requirements of 134 GB for 1-bit, 150 GB for 2-bit, 176–208 GB for 3-bit, 256 GB for 4-bit, and 272 GB for 8-bit. Its example configuration uses the 143.9 GB UD-Q2_K_XL quant, high reasoning effort, and CPU/GPU offloading as needed.

Unsloth reports its own top-1 agreement and KLD comparisons across seven categories; for example, it lists 88.5% general-chat agreement for Q2 and 97.3% for Q4. The documentation does not establish independent benchmark performance, real-world throughput, or that these requirements will fit every hardware and runtime configuration.

Evidence / sources

  1. 1unsloth.ai/docs/models/minimax-m3.1-flash
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicMultimodalExplore the multimodal topic hub.
  2. 02archiveField NotesOpen the latest editorial analysis.
  3. 03source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract