I’ve implemented Leap Motion hand tracking support in Unreal engine 5.3 using the latest version 5.0.1 Ultraleap Tracking Plugin and the latest Hyperion version 6.2.0 device drivers and service. However, the fidelity of the finger tracking is poor and while I’ve done the following to improve it, still require additional guidance.
The tracker is attached to a bracket approximately 100cm above the face of the VR headset looking forward, and approximately 30 degrees below the horizon. This helps a little by giving an improved few of the top of the hand.
Additionally, in order for the hands to register, I have to make a quick downward glance. (No clue why)
After adding a leap component to my player controller, I configure the component for “Leap Multi Device Singular”, “Leap Mode VR”, and with the following hints, policies, and options.
Hints:
“ultra_performance_mode”
“user_input”
“high_background_illumination”
“app_immersive”
Policies:
“Leap Policy Optimize HMD” = True
“Leap Policy Background Frames” = False
“Leap Policy Images” = False
“Leap Policy Allow Pause Resume” = False
“Leap Policy Map Points” = False
Options:
“Use Time Warp” = false
“Use Interpolation” = false
“HMDPosition Offset” = (0.0, 0.0, 10.0)
“HMDRotation Offset” = (0.0, -30.0, 0.0)
What else can I do to improve the accuracy and fidelity of the tracking?
Edits:
Fixed cm offset value.
Added note about looking down.