Enabling Time Data Monitor plugin

Aligning the frame rate of data sources and Unreal Engine

Adding a tracking delay to Live Link or Time Correction

<aside> <img src="/icons/warning_red.svg" alt="/icons/warning_red.svg" width="40px" /> WARNING: None of the IBIS (In Body Image Stabilizer) or lens optical stabilizer work with VIVE Mars tracking system, please turn them off before using with VIVE Mars. Image stabilizer artificially eliminates micro jitter on camera body but VIVE Tracker (Rover) still detects this micro jitter. This causes composited footage jitter or impact the accuracy of lens calibration results.

</aside>

Overview


In Virtual Production, Unreal Engine can receive multiple sources through Live Link (tracking data) and SDI (video frames) at the same time. These sources would have timing synchronization issues since tracking data usually arrives earlier than video frames. Unreal provides a visualized tool plug-in, Timed Data Monitor, to deal with timing sync. This tutorial would guide you on how to use Timed Data Monitor to align video frames and virtual frames (tracking data).

  1. If you haven’t completed a real-time composition project, please see Real-time compositing in Unreal Engine.
  2. The Timed Data Monitor is a tool of Unreal Engine to configure and visualize how all incoming timed data from multiple sources through Live Link or SDI. See Enabling Time Data Monitor plugin to enable it.
  3. Ensure the frame rate of each source — camera, VIVE Mars, and Unreal Engine are at the same frame rate. See Aligning the frame rate of data sources and Unreal Engine.
  4. Add a tracking delay (offset) and align virtual and video frames visually in Time Data Monitor. See Adding a tracking delay to Live Link or Time Correction.

<aside> <img src="/icons/flash_yellow.svg" alt="/icons/flash_yellow.svg" width="40px" /> IMPORTANT: You would need to enable Timecode and Genlock in order to output render footages that will consistently align with the video sources in post-production.

</aside>

Example of unsynced frames

2022-10-28 15-47-00trimed.mp4

Example of synced frames

2022-10-28 17-42-20_Trim.mp4

A reference setup for this tutorial

MicrosoftTeams-image (4).png