{"type":"post","id":"day-0-support-for-flint-on-vllm-2c6d85","slug":"day-0-support-for-flint-on-vllm-2c6d85","title":"Day-0 Support for Flint on vLLM","description":"vLLM says its Flint-specific serving support is available from day one, covering Recursive’s NVFP4 and BF16 checkpoints.","retrieval_nugget":"vLLM says its Flint-specific serving support is available from day one, covering Recursive’s NVFP4 and BF16 checkpoints. On one NVIDIA GB200, the project reports roughly 485 output tokens per second at batch size one and a 100,000-token context, making this a concrete inference result for teams testing Flint on Blackwell hardware.","published_at":"2026-11-12","updated_at":"2026-11-12","record_date":"2026-11-12","date_kind":"published_at","topics":["inference","ai-infrastructure","models"],"entities":["vLLM","Flint","Recursive","NVIDIA GB200"],"related_patterns":["harness-architecture-outlives-model-choice"],"novelty_label":"new_fact","what_changed":"The announcement reports about 500 tokens per second on one GB200, including with 100K tokens of context.","prior_refs":[],"source_url":"https://vllm-project.github.io/2026/10/21/flint.html","source_urls":["https://vllm-project.github.io/2026/10/21/flint.html"],"schema_version":"newruntime-agent-readable-v0.2","stable_id":"post:day-0-support-for-flint-on-vllm-2c6d85","status":"published","visuals":[],"editor":{"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]},"routes":{"html":"https://newruntime.com/posts/day-0-support-for-flint-on-vllm-2c6d85/","markdown":"https://newruntime.com/posts/day-0-support-for-flint-on-vllm-2c6d85.md","json":"https://newruntime.com/posts/day-0-support-for-flint-on-vllm-2c6d85.json"},"markdown_url":"https://newruntime.com/posts/day-0-support-for-flint-on-vllm-2c6d85.md","next_reads":[{"type":"topic","path":"/topics/inference/","url":"https://newruntime.com/topics/inference/","title":"Inference","reason":"Explore the inference topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/inference.md","json_url":"https://newruntime.com/topics/inference.json"},{"type":"topic","path":"/topics/ai-infrastructure/","url":"https://newruntime.com/topics/ai-infrastructure/","title":"Ai Infrastructure","reason":"Explore the ai-infrastructure topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/ai-infrastructure.md","json_url":"https://newruntime.com/topics/ai-infrastructure.json"},{"type":"topic","path":"/topics/models/","url":"https://newruntime.com/topics/models/","title":"Models","reason":"Explore the models topic hub.","media_type":"text/html","markdown_url":"https://newruntime.com/topics/models.md","json_url":"https://newruntime.com/topics/models.json"},{"type":"collection","path":"/posts/","url":"https://newruntime.com/posts/","title":"Field Notes","reason":"Open the latest editorial analysis.","media_type":"text/html","json_url":"https://newruntime.com/posts.json"},{"type":"collection","path":"/sources/","url":"https://newruntime.com/sources/","title":"Sources","reason":"See the original sources this archive cites.","media_type":"text/html"}]}