Camera Tracking Systems
Optical camera position, lens data and real-time production integration.
RedSpy is stYpe’s optical camera tracking system. It combines infrared observations with inertial sensing to deliver camera position and orientation, with zoom and focus data for the virtual camera. It serves XR, LED virtual production, green-screen studios and location-based AR graphics.
Product brand: stYpe
Overview
Matching a virtual scene to live footage requires both camera motion and lens information. RedSpy supplies pose and lens-related data. Camera offsets, scene coordinates and lens calibration establish how the renderer uses those measurements. As the camera translates, rises, circles a subject or changes focal length, the virtual viewpoint can follow the corresponding perspective.
In focus
Capture X, Y and Z position together with pan, tilt and roll. Optical and inertial sensing support moving rigs such as handheld cameras, stabilizers, pedestals and cranes, giving the renderer the motion needed to update perspective.
Read zoom and focus through compatible digital lens connections or external encoders. Lens files map the readings to the virtual lens for field-of-view and distortion correction throughout the calibrated shooting range.
Transmit tracking over Ethernet using FreeD, Stype HF or EEVEC. Configure axes, units, camera identifiers and timing for the receiving platform so each stream updates the intended virtual camera.
Retain tracking records for shot review, motion checks and post-production hand-off. Associate the records with footage, timing and lens files to reconstruct shot conditions and investigate alignment.
Workflow
Tracking and video follow separate signal paths. Spatial and lens calibration establish image alignment; synchronization and delay settings establish their timing relationship.
A camera-mounted tracker observes the marker environment and combines those observations with inertial data.
Apply mounting offsets and process the connected zoom and focus readings.
Send measurements to the designated render node using the configured network address and protocol.
The renderer applies coordinate conversion, lens mapping and timing offsets to produce the scene from the measured viewpoint.
Integration
Plan the marker space, mounting, lens calibration, network and synchronization together. Use the camera and lens intended for production during commissioning, and test the full shooting route rather than a single stationary position.
Review the room structure, camera heights and movement paths. Check marker visibility during tilts, low angles and moves around set elements; include lighting fixtures, scenery and cabling in the review.
Secure the tracking unit and any lens encoders. Establish the relationship between the tracker and camera, then complete spatial and lens calibration. Check wide and long focal lengths and the focus distances used in production.
Send camera video through the production chain and tracking data to the matching render camera. Plan the sync reference and video format, then verify reception and temporal alignment.
Test translation, rotation, elevation, zoom and camera changes. Inspect both image edges and near/far reference points. Save the map, lens files and receiver settings used for the project.
Configuration
| Tracking method | Infrared optical tracking with inertial sensing |
|---|---|
| Camera data | Position X / Y / Z; orientation Pan / Tilt / Roll |
| Lens data | Zoom / Focus; compatible digital connection or external encoders |
| Data transport | Ethernet / UDP |
| Protocols | FreeD / Stype HF / EEVEC |
| Synchronization | Genlock; planned with the production video chain |
| Camera setups | Handheld, stabilizer, pedestal, crane |
| Recording | Tracking-data recording for review and post-production |
Applications
Update the background viewpoint as the camera moves. Commission tracking alongside the lens, display and synchronization systems rather than treating it as a separate final task.
Combine camera movement with keying and virtual scenery for studio programmes. Recheck the lens setup when changing the lens used for production.
Place virtual graphics in the perspective of the real camera. Establish site coordinates and reference positions before checking alignment through moving shots.
Engineering decisions
Supply stage dimensions, set heights, lighting positions and camera routes. Check marker visibility with the tracking unit in its actual low-angle, overhead and moving positions. Floor area alone does not define coverage; temporary scenery and people can obstruct otherwise usable sightlines.
List the camera sensor mode, lens model, focal lengths and focus range. Confirm lens interfaces, encoders and optional modules for the supplied revision. Receiving lens values is separate from calibrating field of view, distortion and the offset between tracker and camera.
Map camera video, tracking data and reference timing, including any timecode source. Confirm receiver version, protocol, camera ID, axes, units and network ports. Treat recording exports and wireless operation as explicit configuration and licensing requirements, not assumed inclusions.
Place near, middle and distant references throughout the working area. Test translation, elevation and rotation with the production camera, including typical zoom and focus combinations. Record center and edge alignment, recovery after occlusion and all settings against an agreed image-error criterion.
Once spatial calibration is stable, record fast pans, stops and reversals through the complete composite chain. Look for graphics leading or trailing the picture. Retain video-buffer, receiver and render settings; a component latency figure is not an end-to-end measurement.
Repeat reference shots after the planned startup and remounting procedures. Check maps, lens files, mount positions and receiver settings. Document which changes require recalibration, and, where tracking exports are required, compare a sample export with the associated footage and timing.
FAQ
It supplies camera movement and lens-related data. Rendering hardware produces the scene, while video equipment handles image signals. They are configured together as the production chain.
Connect zoom and focus readings and calibrate the actual lens and camera image area. Check the working focal lengths, focus distances and image edges, not only a central reference point.
Use the camera route, height, tilt range and set obstructions to plan marker coverage and tracker orientation across the intended shooting area.
Review the marker map, camera offset and lens configuration. Update the relevant calibration when spatial references or mechanical relationships change, then test a representative moving shot.
Share the platform and version, camera and lens models, video format, sync arrangement, camera count and movement routes. These define the data, mounting and lens setup.
No. Moving markers, remounting the tracking unit, changing sensor mode or replacing a lens can alter the calibrated relationship. Automatic startup or map recognition does not replace a check along the intended shooting route.
Use the supply specification identifying hardware generation, firmware, options and licenses, then test the required output on that configuration. A current web page and a downloadable brochure can describe different revisions; their best figures should not be combined into a new specification.
RedSpy is a stYpe product. Confirm the supplied version, options and licenses. Lecen's selection, installation, calibration and production integration scope is agreed per project; compatibility and performance require acceptance testing on that configuration.
These references explain principles and integration conditions. Confirm capabilities against the supplied revision, project configuration and agreed tests.
Project brief
Models, lens interfaces and working focal range.
Camera movement, stage layout and mounting conditions.
Rendering platform, video format and synchronization.
Explore more
Camera Tracking Systems
Optical camera and lens tracking for everyday XR, VP and AR production.
Optical camera tracking setup illustration
View product
Professional Rendering Servers
A rendering platform for XR scenes, video integration and programme output.
AI-generated concept, not a product or project photograph.
View product
Professional Rendering Servers
Render nodes configured for LED canvases, camera views and synchronized output.
AI-generated concept, not a product or project photograph.
View productExplore more
Virtual Production & Live Graphics
Connect LED content, set extension and foreground AR.
AI-generated concept, not a product or project photograph.
Explore solutionVirtual Production & Live Graphics
Digital environments that take part in the real shot.
AI-generated concept, not a product or project photograph.
Explore solution
Virtual Production & Live Graphics
Place live graphics and data in the real scene.
AI-generated concept, not a product or project photograph.
Explore solutionTalk to Lecen
Share the camera, lens and studio layout to discuss mounting, calibration and render-system integration.