{"type":"post","id":"tpu-model-design-considerations-and-optimization-guide-cc73e7","slug":"tpu-model-design-considerations-and-optimization-guide-cc73e7","title":"TPU Model Design Considerations and Optimization Guide","description":"Google has published an open guide to co-designing model architectures and workloads for its TPU hardware, with rules for dimensions, routing, parallelism and serving.","retrieval_nugget":"Google has published an open guide to co-designing model architectures and workloads for its TPU hardware, with rules for dimensions, routing, parallelism and serving. For teams building on TPUs, the useful shift is from generic model choices to hardware-aware decisions tested in wall-clock ablations, not assumed from FLOPs alone.","published_at":"2026-11-17","updated_at":"2026-11-17","record_date":"2026-11-17","date_kind":"published_at","topics":["google"],"entities":["Google","AI-Hypercomputer/tpu-codesign","Ironwood","TPU 8t","TPU 8i"],"related_patterns":[],"novelty_label":"new_fact","what_changed":"Google has published an open-source TPU model-design guide with hardware-specific rules for shapes, architecture, and parallelism, including guidance for Ironwood and future TPU generations.","prior_refs":["https://newruntime.com/posts/introducing-tpu-8tx-and-tpu-8i-max-b6c8a7/"],"source_url":"https://developers.googleblog.com/tpu-model-design-considerations-and-optimization-guide","source_urls":["https://developers.googleblog.com/tpu-model-design-considerations-and-optimization-guide"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:tpu-model-design-considerations-and-optimization-guide-cc73e7","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/tpu-model-design-considerations-and-optimization-guide-cc73e7/","markdown":"https://newruntime.com/posts/tpu-model-design-considerations-and-optimization-guide-cc73e7.md","json":"https://newruntime.com/posts/tpu-model-design-considerations-and-optimization-guide-cc73e7.json"},"markdown_url":"https://newruntime.com/posts/tpu-model-design-considerations-and-optimization-guide-cc73e7.md","next_reads":[{"type":"topic","path":"/topics/google/","url":"https://newruntime.com/topics/google/","title":"Google","reason":"Explore the google topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/google.md","json_url":"https://newruntime.com/topics/google.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}
