Tutorial: Co-Simulation UE and Omniverse - "SpaceVerse" GTC demo - Return on Experience.

Hi,

In this case, the motivation was exploratory. It was to benchmark the USD live connection between Omniverse and Unreal.

Unreal brought better visualization capabilities, and was able to enhance the output of one animation done in Omniverse.

But the very same result could have been achieved directly in Unreal in this case. The USD live session brought some jittering artifacts (no timestamps, so depending on network latency without smoothing), and precision (floating points vs double precision in UE).
Using the CSV files in UE allowed for a smoother result.

The conclusion was that it was possible to connect both applications for “near-interactive” exchanges, but for pure real-time applications (like virtual / man-in-the-loop training simulations), the exchange protocol was not robust enough.