NVIDIA releases Cosmos 3 omnimodal world models

NVIDIA researchers introduced Cosmos 3, a family of omnimodal world models designed to jointly process and generate language, images, video, audio, and action sequences within a unified mixture-of-transformers architecture. The system aims to serve as a general-purpose backbone for Physical AI by unifying diverse capabilities like vision-language understanding, video simulation, and robot action-prediction into a single framework. According to the evaluation, the models establish new state-of-the-art results across various understanding and generation tasks and are made openly available under the OpenMDW-1.1 License. Open article →