LATIDIA · Robótica

Simulación interactiva del mundo con Cosmos para IA física

arXiv: 2611.06627v1Tipo de anuncio: Cross Resumen: Presentamos un marco compartido que adapta los modelos de fundamentos mundiales de Cosmos para la simulación interactiva de mundos en tiempo real en IA física. Mediante la transmisión de observaciones visuales en re

La noticia

arXiv:2611.06627v1 Announce Type: cross Abstract: We present a shared framework that adapts Cosmos world foundation models for real-time interactive world simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the framework enables users and embodied agents to interact with evolving virtual environments. It supports both predicting the visual consequences of actions and generating observations from physical state maintained by an external simulator. We demonstrate this approach across camera navigation and robot manipulation, controllable video transfer, and multi-view autonomous vehicle (AV) simulation. These examples provide a shared foundation for developing interactive virtual environments for Physical AI training and evaluation. Our code and model checkpoints are