Field noteOct 24, 20261 min read1 source

IST Austria DASLab releases GSQ-RCO non-uniform GGUF quantizations of DeepSeek-V4.1-Flash-1017 at 1.75-2.25 bits per weight

In one minute

ISTA DASLab at the Institute of Science and Technology Austria has published three GSQ-RCO GGUF quantizations of DeepSeek-V4.1-Flash-1017 on Hugging Face.

What changed: ISTA-DASLab now provides GSQ-RCO GGUF quantizations for DeepSeek-V4.1-Flash-1017 at 1.75, 2.00, and 2.25 bits per weight, rather than the previously covered Qwen3.8-Flash-Next build.

The source describes the base as a 763.2B-parameter, 384-expert mixture-of-experts model, with six routed experts active per token and a 1M-token context window.

The releases are IQ1_M at 1.75 bits per weight and 231.32 GB total, IQ2_XXS at 2.00 bits and 248.84 GB, and IQ2_XS at 2.25 bits and 265.83 GB. A shared 110.60 GB Engram lookup-table file is required alongside four backbone shards. The repository recommends IQ2_XXS; its reported task average is 93.54, matching the cited FP8/FP4 base on AIME25, GPQA-Diamond, and LiveCodeBench v6 at reasoning effort 50.

The card says the files run with Strata on one NVIDIA GPU with 12 GB of VRAM by using system memory and memory-mapping the Engram tables from SSD. It also says llama.cpp did not support DeepSeek-V4.1 as of October 23, 2026. The source does not establish independent benchmark replication, real-world throughput, total host-memory requirements, or performance on hardware other than the stated setup.

Evidence / sources

  1. 1huggingface.co/ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF
All Field Notes

Next reads

Read next

Open the graph
  1. 01topicLocal ModelsExplore the local-models topic hub.
  2. 02topicOpen ModelsExplore the open-models topic hub.
  3. 03topicInferenceExplore the inference topic hub.
  4. 04archiveField NotesOpen the latest editorial analysis.
  5. 05source ledgerSource LedgerInspect the public source evidence graph.
Who read this page?Machine requests, hidden until opened

Loading the privacy-safe route aggregate...

Open the JSON contract