TrakInect V2 brings the Microsoft Kinect V2 sensor to life inside Unreal Engine 5, enabling real-time skeletal motion capture and face tracking with zero external middleware.
The plugin exposes a lightweight Actor Component (UKinectBodyActor) that streams all 25 Kinect V2 joints into UE5 every frame. Joint orientations are converted from Kinect's right-handed coordinate system into UE5's left-handed space automatically — no manual axis remapping needed.
──────────────────────────
KEY FEATURES
──────────────────────────
▸ Real-Time Joint Streaming
All 25 body joints polled and broadcast every tick via a Blueprint Interface.
Ready to plug into any Skeletal Mesh or custom IK system.
▸ Skeletal Mesh Drive
Joint quaternions (converted and permuted to UE5 bone space) can be applied
directly to any Skeletal Mesh's bone rotations at runtime.
▸ Rest-Pose Calibration
One-click T-pose calibration captures the sensor-to-mesh offset and removes
cumulative rotation drift during long sessions.
▸ Per-Joint Debug Gizmos
Every joint displays a 3-axis DrawDebugLine gizmo in the viewport.
Each joint has a runtime-editable debug struct (FKinectJointDebug) so you
can toggle visibility, change colors, and inspect raw vs. calibrated values
without recompiling.
▸ XFace Tracking (soon)X
Access full Kinect V2 face shape units and head pose in real-time.
Pipe data to morph targets or blend spaces with a single Blueprint node.
──────────────────────────
TECHNICAL HIGHLIGHTS
──────────────────────────
• Written entirely in C++ with full source code included.
• Blueprint-friendly: every feature accessible via Blueprint Interface nodes.
• Coordinate conversion handled internally — Kinect right-hand to UE5 left-hand.
• Quaternion permutation (-Z, X, -Y, W) applied per joint for correct UE5 orientation.
• Designed for Windows (required by Kinect for Windows SDK 2.0).
• Tested on Unreal Engine 5.4.
──────────────────────────
USE CASES
──────────────────────────
• Rapid motion capture prototyping without an OptiTrack or Vicon setup.
• Interactive installations and AR/VR experiences using depth-camera input.
• Facial animation research and real-time morph target control.
• Indie game development with full-body player tracking.
• Academic and research projects requiring affordable mocap hardware.
──────────────────────────
REQUIREMENTS
──────────────────────────
• Microsoft Kinect V2 sensor (model 1520)
• Kinect for Windows SDK 2.0 (free, from Microsoft)
• Windows 10 / 11 (64-bit)
• Unreal Engine 5.4
• USB 3.0 port