OCULUS VR - Hand Tracking Collision/Physics

ReyhKt · March 25, 2021, 10:04am

Hi,

We are trying to play with the Oculus Hand Tracking with an oculus quest 2 and UE4 4.26.
Our problem is that we cannot get working the physics simulation with the Oculus Hand Component.
We have setup the body and constraint on the hand mesh but they are still passing through objects …

Did someone have succeed to enable physical simulation with the hand tracking in VR?
The goal is to not use custom poses.

Thanks,

Kassab-6 · April 26, 2021, 11:53pm

i’m facing the same problem, what i’ve noticed if that if tick the option initialize physics AND you dont choose any mesh thus using the oculus hand mesh that is generated on runtime you can actually do physical interactions, hope this helps

kusaflow · September 23, 2021, 7:25am

i had the same problem too but i found a way. in beginplay use “setPhysicsAsset” node to set the physics asset and then call the “initialize Hand Physics” after that its working for me.

intvoker · June 19, 2023, 8:50am

I’ve been using OculusHand SkeletalMesh and fixed CollisionCapsules this way:

github.com

intvoker/RockPaperScissors/blob/master/Source/RockPaperScissors/Private/Components/RPS_PoseableHandComponent.cpp#L17


      
          {
          	Super::BeginPlay();
          
          
	if (bCustomPoseableHandMesh && bInitializePhysics)
          	{
          		AttachCollisionCapsules();
          	}
          }
          
          
// Hackish way to attach CollisionCapsules generated for ovrpSkeleton2 to current SkeletalMesh (works with OculusHand SkeletalMesh)
          void URPS_PoseableHandComponent::AttachCollisionCapsules()
          {
          	// Saving current SkeletalMesh
          	const auto SavedSkeletalMesh = SkeletalMesh;
          
          
	// Generating CollisionCapsules
          	const auto TempSkeletalMesh = NewObject<USkeletalMesh>(this, TEXT("OculusHandMesh"));
          	if (TempSkeletalMesh)
          	{
          		if (UOculusInputFunctionLibrary::GetHandSkeletalMesh(TempSkeletalMesh, SkeletonType, MeshType))
          		{

You do not have to use UPoseableHandComponent, just inherit directly from UOculusHandComponent. And use bCustomHandMesh instead of bCustomPoseableHandMesh.

fateshowMTT · January 29, 2024, 3:32pm

I’ve managed to find a way.

MetaXR Plugin version: 57.0
HMD: Oculus Quest 2
Engine: UE 5.2.1

I created a default VR project and used the VR Pawn.
Deleted the HandRight and HandLeft skeletal meshes from the Components menu.
Removed anything that required the HandRight/Left for input (you could just break the connections if you want to use the code later).
Then at the end of the BeginPlay node I set the skeleton type before initializing the physics. Before I was initializing physics and it wasn’t working.

It seems to generate a box collider from the wrist to first finger joint. I’ve tried adding a Physics Asset for more accurate hand collisions but it’s ignoring them, so I don’t know how this collider is created. Below is an image of what I’ve tried. I’ve already linked the Physics Asset through the hand’s Skeleton etc.

Asta1001 · July 31, 2024, 8:53am

Thanks @kusaflow it working for me too though i have set it in the vr hand settings weird but thanks.