{"type":"post","id":"unsloth-released-dynamic-gguf-quants-of-qwen3-4b-99c55a","slug":"unsloth-released-dynamic-gguf-quants-of-qwen3-4b-99c55a","title":"Unsloth released dynamic GGUF quants of Qwen3-4B-Instruct-2507, now at 838K downloads.","description":"Unsloth’s Hugging Face repository offers 26 GGUF quantizations of Qwen3-4B-Instruct-2507, spanning files from 1.08 GB to 8.05 GB.","retrieval_nugget":"Unsloth’s Hugging Face repository offers 26 GGUF quantizations of Qwen3-4B-Instruct-2507, spanning files from 1.08 GB to 8.05 GB. The practical change is a wider range of local deployment choices, with examples for common runtimes; builders can match a model file to available memory and test the trade-off themselves.","published_at":"2026-11-14","updated_at":"2026-11-14","record_date":"2026-11-14","date_kind":"published_at","topics":["local-models","open-models","inference"],"entities":["Unsloth","Qwen3-4B-Instruct-2507","Hugging Face","llama.cpp"],"related_patterns":[],"novelty_label":"new_fact","what_changed":"Unsloth published dynamic GGUF quantizations for Qwen3-4B-Instruct-2507, whose Hugging Face repository has reached 838,000 downloads.","prior_refs":["https://newruntime.com/posts/unsloth-released-dynamic-v3-1-ggufs-for-qwen3-9154a0/","https://newruntime.com/posts/unsloth-released-dynamic-v3-1-ggufs-for-qwen3-09e489/","https://newruntime.com/posts/unsloth-released-gguf-quants-of-qwen-image-2-936672/","https://newruntime.com/posts/unsloth-ships-dynamic-3-0-gguf-quants-of-1e5a1f/"],"source_url":"https://huggingface.co/unsloth/Qwen3-4B-Instruct-2507-GGUF","source_urls":["https://huggingface.co/unsloth/Qwen3-4B-Instruct-2507-GGUF"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:unsloth-released-dynamic-gguf-quants-of-qwen3-4b-99c55a","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/unsloth-released-dynamic-gguf-quants-of-qwen3-4b-99c55a/","markdown":"https://newruntime.com/posts/unsloth-released-dynamic-gguf-quants-of-qwen3-4b-99c55a.md","json":"https://newruntime.com/posts/unsloth-released-dynamic-gguf-quants-of-qwen3-4b-99c55a.json"},"markdown_url":"https://newruntime.com/posts/unsloth-released-dynamic-gguf-quants-of-qwen3-4b-99c55a.md","next_reads":[{"type":"topic","path":"/topics/local-models/","url":"https://newruntime.com/topics/local-models/","title":"Local Models","reason":"Explore the local-models topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/local-models.md","json_url":"https://newruntime.com/topics/local-models.json"},{"type":"topic","path":"/topics/open-models/","url":"https://newruntime.com/topics/open-models/","title":"Open Models","reason":"Explore the open-models topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/open-models.md","json_url":"https://newruntime.com/topics/open-models.json"},{"type":"topic","path":"/topics/inference/","url":"https://newruntime.com/topics/inference/","title":"Inference","reason":"Explore the inference topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/inference.md","json_url":"https://newruntime.com/topics/inference.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}