The system is trained on synchronized procedure video and robot kinematics recorded on CMR Surgical’s Versius platform, and conditions generated video on instrument actions. The authors report interactive operation on a single NVIDIA RTX PRO 6000 GPU and provide four-step and two-step student checkpoints, with the latter trading visual quality for faster inference. FlashDreams provides streaming inference; an adapted FadeMem module consolidates attention history during longer rollouts. The release is a research simulator, not a validated patient-care system. The source says visual realism is not proof of biomechanical accuracy and lists surgeon evaluation, broader instrument support, and integration with numerical simulation as future work. Source: https://huggingface.co/blog/nvidia/cosmos3-h-dreams
NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation
In one minute
NVIDIA introduced Cosmos3-H-Dreams, a generative simulator for clinical cholecystectomy scenes.
What changed: NVIDIA announced Cosmos3-H-Dreams, a real-time generative surgical simulator trained on clinical Versius cholecystectomy recordings, extending simulation-based robotics research into surgery.