Has hand gesture input been implemented for Vision Pro?

Development Platform & Builds
, ,
1

I’m curious to know if it’s possible to get hand input or tracking on AVP or if there are plans to implement this.

2

Hi!

Hand Tracking works through our OpenXR Hand Tracking API - it gives you access to each joint transform, and you can build gesture input with that data. However, the visionOS gesture API is locked under the Reality Kit-renderer and is not accessible to us when using Metal. We don’t know if or when it will be available to us.

3

How about getting input from a game controller connected to the vision pro or the ps vr 2 controllers, have you had a chance to try those with vision pro?

4

Game controller works, but we’ve yet to implement support for PSVR2 controllers. It’s on the roadmap, but we have no timeline to share.

5

Got it. Thanks

6

I have managed to get the PSVR2 controllers working for movement, rotation and picking up of items in the PolyArc fork of Unreal Engine 5.6. What I can’t get working (yet) is the 6DOF for the Vision Pro, so objects that are picked up do not track to the PSVR2 controllers. Instead they stay static in front of the VR Pawn. Trying to roll my own plug-in right now now that might get this to work, but would love to see PSVR2 support come natively to UE at some point. Thanks!