The schematics below are two examples of how VIVE Mars fits the pipeline for Virtual Production using a green screen or LED wall.
<aside> <img src="/icons/archive_blue.svg" alt="/icons/archive_blue.svg" width="40px" /> CATALOG
</aside>
Rover
Rover collects tracking data from VIVE Tracker (3.0) and relays it to Mars. See Rover for details.
Lens Encoder
If an external lens encoder is connected to the Rover, then the Rover will also transmit integer data as FIZ (Focus, Iris, Zoom) through Mars to the virtual production software.
<aside> <img src="/icons/pencil_green.svg" alt="/icons/pencil_green.svg" width="40px" /> NOTE: VIVE Mars CamTrack supports VIVE Mars FIZTrack and LOLED Indiemark lens encoder.
</aside>
Mars
Mars collects tracking data and encoder data from up to three Rovers and sends it to your PC either directly wired or through an IP router. See Mars for details.
Genlock
If an external Genlock (e.g: AJA GEN10 HD/SD Sync Generator) is connected, Mars would sync the tracking data to the frequency of the Genlock setting. This helps synchronize all connected machines to the same frame rate.
Timecode
If an external Timecode Generator (e.g: Ambient Recording ACN-CL Lockit) is connected, Mars would embed the master timestamp into tracking data. Some camera tracking protocols, such as Live Link, support the timecode metadata. This helps frame alignment in live or post-composition.
<aside> <img src="/icons/light-bulb_orange.svg" alt="/icons/light-bulb_orange.svg" width="40px" /> TIP: Without external Genlock and Timecode machines, it’s still possible to have composited footage, however you may require more manual adjustments to have the camera footage match your virtual background.
</aside>
Virtual Production Software
Virtual production software receives tracking data through a messaging protocol, such as Live Link for Unreal, FreeD for Aximmetry, Zero Density, and Disguise. It renders out frames from the viewpoint of the tracked virtual camera. Virtual production software also receives the camera video feed from the video capture card, and then composite rendered frames and camera footage.
One of the differences from Green Screen Real-time compositing, is for LED wall the Virtual Production software doesn’t receive the camera video feed, instead, the compositing is done in real-time when the camera is capturing the subject against an LED Wall.
Genlock
If an external Genlock (e.g: AJA GEN10 HD/SD Sync Generator) is connected, Mars would sync the tracking data to the frequency of the Genlock setting. This helps synchronize all connected machines to the same frame rate.
<aside> <img src="/icons/light-bulb_orange.svg" alt="/icons/light-bulb_orange.svg" width="40px" /> TIP: Most Virtual Production setups require synchronization over multiple machines. For an LED wall pipeline, Genlock is crucial to make sure the Camera, PC, and LED wall are in sync.
</aside>
Virtual Production Software
Virtual production software receives tracking data through a messaging protocol, such as Live Link for Unreal, FreeD for Aximmetry, Zero Density, and Disguise. It renders out frames from the viewpoint of tracked virtual camera and outputs the rendered footage to projectors or LED walls.