{"type":"post","id":"google-released-gemma-4-e4b-qat-q4-0-17e441","slug":"google-released-gemma-4-e4b-qat-q4-0-17e441","title":"Google released Gemma 4 E4B QAT Q4_0 GGUF , a 5.15 GB on-device multimodal model.","description":"**Thesis:** Quantization-aware training is making local model distribution more practical by packaging reduced-memory weights in a format intended for broad ecosystem compatibility.","retrieval_nugget":"**Thesis:** Quantization-aware training is making local model distribution more practical by packaging reduced-memory weights in a format intended for broad ecosystem compatibility.","published_at":"2026-10-14","updated_at":"2026-10-14","record_date":"2026-10-14","date_kind":"published_at","topics":["google"],"source_urls":["https://huggingface.co/google/gemma-4-E4B-it-qat-q4_0-gguf"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:google-released-gemma-4-e4b-qat-q4-0-17e441","status":"published","visuals":[],"editorial_provenance":{"schema_version":"newruntime-editorial-copy-v1","content_status":"source_grounded_final","final_copy_sha256":"sha256:57fdf314d9133952129ea56b1a230b49fea608826ead1b92777b3ca112f18633","reviewed_at":"2026-10-14T16:11:11.618Z","source_evidence_count":1,"verified_claim_count":3,"site_analysis_schema_version":"newruntime-site-analysis-v1","site_object_kind":"field_note","observed_fact_count":3,"implication_count":2,"watch_condition_count":1,"related_record_count":0},"analysis":{"schema_version":"newruntime-site-analysis-v1","object_kind":"field_note","thesis":"Quantization-aware training is making local model distribution more practical by packaging reduced-memory weights in a format intended for broad ecosystem compatibility.","observed_facts":[{"text":"Google’s Hugging Face card lists an instruction-tuned Gemma 4 E4B QAT checkpoint in GGUF Q4_0 format.","source_urls":["https://huggingface.co/google/gemma-4-E4B-it-qat-q4_0-gguf"]},{"text":"It gives the file size as 5.15 GB and says QAT is intended to reduce memory needs while preserving quality similar to bfloat16.","source_urls":["https://huggingface.co/google/gemma-4-E4B-it-qat-q4_0-gguf"]},{"text":"The card describes E4B as supporting text, image, and audio input, with a 128K-token context window.","source_urls":["https://huggingface.co/google/gemma-4-E4B-it-qat-q4_0-gguf"]}],"mechanism":"QAT incorporates quantization into training so that lower-precision weights are not simply an after-the-fact conversion. The checkpoint is distributed in GGUF, which Google describes as a ready-to-deploy format for broad ecosystem compatibility. This packages a reduced-memory artifact that local-runtime builders can try without first producing their own quantized export.","why_now":"The release turns the Gemma 4 E4B option into a specific downloadable local artifact; the model card’s 5.15 GB figure gives builders a concrete starting point for hardware-fit testing.","implications":["Builders can test whether a QAT GGUF checkpoint makes multimodal Gemma 4 E4B viable within their local memory budget.","Runtime memory use, speed, and task quality still need device- and workload-specific evaluation."],"evidence_boundary":"The evidence is the vendor-published model card: its claim of quality similar to bfloat16 is not independent validation, and file size does not establish runtime memory use, speed, or task-level quality on any particular device.","watch_conditions":["Compare this checkpoint with the bfloat16 baseline on representative tasks and devices, measuring peak memory, latency, and output quality."],"related_records":[],"new_branch_reason":"No prior New Runtime record was supplied; this is a distinct record of the specific E4B QAT GGUF distribution, not an invented link to an earlier record."},"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/google-released-gemma-4-e4b-qat-q4-0-17e441/","markdown":"https://newruntime.com/posts/google-released-gemma-4-e4b-qat-q4-0-17e441.md","json":"https://newruntime.com/posts/google-released-gemma-4-e4b-qat-q4-0-17e441.json"},"next_reads":[{"type":"topic","path":"/topics/google/","url":"https://newruntime.com/topics/google/","title":"Google","reason":"Explore the google topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/google.md","json_url":"https://newruntime.com/topics/google.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/source-ledger.json","url":"https://newruntime.com/source-ledger.json","title":"Source Ledger","reason":"Inspect the public source evidence graph.","media_type":"application/json"}]}