Frequently Asked Questions

Can Cosmos Models capture brief dynamic actions?

Yes, you can use the Generator aspect of the model to generate videos that match specific dynamics.

What perspective do videos generated by the Cosmos Predict1 models use?

The perspective of generated videos can be specified using video/text prompts. If you post-train a model using videos from a particular model of autonomous vehicle (AV) or robot, the model will preferentially generate videos from its perspective.

Do Cosmos Models generate videos with collisions or other unsafe scenarios?

Cosmos models don’t deliberately avoid generating collision videos. On the contrary, out of distribution (OOD) data can better assist the downstream AV system in evaluating and fine-tuning for corner cases.

Is human intervention required for video labeling?

No, the video-labeling pipeline is fully automated. The Cosmos team has worked to fine-tune the filtering and annotation models used in the pipeline to ensure that the labels are accurate and consistent.

Can I use assets from 3D engines like Unreal Engine and Omniverse?

Yes, you can use the Transfer skill to convert videos from any simulation engine into a realistic style.