[Plugin] Leap Motion - Event Driven

[Alllesss]

Hi Getnamo,

I'm trying to Control Leap Echo hands Rigged Child Actor's components from My_Character over blueprints . I tried to cast to it just to get the Left hand Mesh :



But this always get failed , Am I doing something wrong ?!

[vhung92]

It's integrated directly in the engine now in 4.11

http://blog.leapmotion.com/leap-moti...unreal-engine/

Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

More thorough documentations on the new stuff incoming over the next few days.

That's awesome, can't wait for the documentation on the new stuff! Ever since I saw Orion I've been wanting to try it out.

Also i would like to ask if you could help me out with translating the fingers 3D world position to the widgets local 2D position? Currently I'm taking the rt_middle_a socket position and then using ProjectWorldLocationToWidgetPosition (I've also tried ConvertWorldLocationToScreenLocation which performed worse) to set the cursor image I have in my menu widget using SetPosition with the image as a Canvas Slot and I can get the image to move with the hand, but the image moves at a slower ratio than my hand so If I'm at the edges of my Menu then there's a discrepancy between the finger position and the cursor image's position. Any idea how I can solve it?

Thanks in advance!

[Rukasu]

Hey,

I've encountered some problem using leapmotion + player teleportation/rotation.

I am working on a project that uses the oculus, to get a view of the backside we teleport the player to the new location and rotate him 180 degrees, so he looks straigth at the backside of the object.
The problem is, the controller (LeapEchoCollusionCharacter) doesn't rotate with the player. That means the right hand always shows up, but the left hand doesn't. It is positioned behind the player and you have to look at it first in order to be able to use it.

I need a workaround for this, 'cause we can't have it this way.

Just wanted to say that my Problem solved itself with the new Plugin that comes with 4.11 , great job!

[Rend]

It's integrated directly in the engine now in 4.11

http://blog.leapmotion.com/leap-moti...unreal-engine/

Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

More thorough documentations on the new stuff incoming over the next few days.

Getnamo you're my hero!

[virtualHC]

It's integrated directly in the engine now in 4.11

http://blog.leapmotion.com/leap-moti...unreal-engine/

Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

More thorough documentations on the new stuff incoming over the next few days.

Ah! great! Congratulations.

[getnamo]

OK, it wasn't that difficult. You just need to replace in the source all the SetFlags(RF_RootSet) calls with AddToRoot() and the HasAnyFlags(RF_RootSet) calls with IsRooted() and the plugin compiles. I did a quick test with a new 4.11 project and it seemed to work. Maybe Getnamo can confirm that this is correct and not just a hack.

Cheers!

It's integrated directly in the engine now in 4.11

http://blog.leapmotion.com/leap-moti...unreal-engine/

Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

More thorough documentations on the new stuff incoming over the next few days.

[virtualHC]

The plugin needs to be recompiled for 4.11 but presently that throws a lot of errors. I'm trying to fix them since I do need the plugin working on 4.11 soon. On the other hand, 4.11 final is officially out today so maybe this Leap plugin will now get some 4.11 love from the developers.

OK, it wasn't that difficult. You just need to replace in the source all the SetFlags(RF_RootSet) calls with AddToRoot() and the HasAnyFlags(RF_RootSet) calls with IsRooted() and the plugin compiles. I did a quick test with a new 4.11 project and it seemed to work. Maybe Getnamo can confirm that this is correct and not just a hack.

Cheers!

[virtualHC]

Hi Getnamo, thanks for your plugin, we have had it working brilliantly. I was wondering if you are planning to update to 4.11 anytime soon? Unfortunately - trying and failing to be clever and 'future proof' we decided to build our project in 4.11 and now we want to integrate leap motion UE4 throws up a load of errors when we try to put the plugin in our project. Screenshots of the errors attached if they are of any help to you. thanks again!

The plugin needs to be recompiled for 4.11 but presently that throws a lot of errors. I'm trying to fix them since I do need the plugin working on 4.11 soon. On the other hand, 4.11 final is officially out today so maybe this Leap plugin will now get some 4.11 love from the developers.

Cheers!

[JLBXB3]

Im am making a multiplayer game with leap motion however the hands of all players respond to the input of just one player, how can I fix this and make it individual to the client.

For example, I have my game running on two computers and when I put my hands in front of my face while on client 1, client 2's player does the exact samething. It only does this for the leap input, using wasd to move is indeed isolated to the individual clients as it should be.

[Red_Baron_]

Can i create custom gestures with this plugin?

[Alllesss]

I got a Problem with Changing the Parent Class of "Leap Basic Rigged Character" from Character(C++) to Spectator Pawn(C++). I just assigned everything exactly the same as before after Reparenting but Ingame my hands are not controlling the Skeletal mesh. Did I miss something here ?! I really don't want my movement class to be Character, so have to change it to get 6-DOF kind of navigation.

[vhung92]

This might be a load order problem, see if changing the load order inside https://github.com/getnamo/leap-ue4/...Motion.uplugin would solve that (try predefault).

Hey getnamo, thanks for the reply! I tried adding the line

"LoadingPhase": "PreDefault"

but I still have the same issue. The workaround is not really hindering me in any way and I would like to ask another question regarding the Leap and UMG.

I would like to have Leap interaction with a 3D menu that I have. I've managed to attach the menu to my custom leap character (subclassing LeapCollisionCharacter) because I want the menu to follow the camera movements of the user as shown below:


However, I'm not entirely sure where to start in order to get the menu to interact with the hand. I found this link https://answers.unrealengine.com/que...or-3d-umg.html where you said you are using the same hack but I'm guessing instead of using the mouse position you use the hand position translated to (x,y) that you described here. Is it possible for you to put up the blueprint you were using or a tutorial on how to dit?

EDIT: I've tried first by adding OnComponentBeginOverlap(menu) as well as adding a box collider and using OnComponentBeginOverlap(box) to just print the location of the hit (breaking the hit result) but it's not generating any overlap events.


EDIT2: So I figured out what was wrong, I had forgotten to enable "Generate Overlap Events" on the hand meshes and I can now get events when the hand overlaps with the menu widget, Now I'm looking at translating the 3d world location of the hand to the widgets local space as well as calling functions on the menu widget.


Thanks in advance!

[Ders92]

I think that the right place should still be https://github.com/getnamo/leap-ue4/...aceUtility.cpp. E.g. multiplying the UE_TO_LEAP_SCALE by w2m inside the code, will try this approach next time I do a plugin pass.

Everything works now! This is what solves it in the function convertAndScaleLeapToUE:
float w2m = GWorld->GetWorldSettings()->AWorldSettings::WorldToMeters / 100.0f;
FVector vect = FVector(-leapVector.z * LEAP_TO_UE_SCALE * w2m, leapVector.x * LEAP_TO_UE_SCALE * w2m, leapVector.y * LEAP_TO_UE_SCALE * w2m);

this is something i tried at first but the thing i missed was that the size of the hand meshes has to be scaled with the same factor (w2m). So I just exported your hands to blender, scaled them and then reimported them and force replaced the old hands_lo and its skeleton with the new. I got a weird orientation error but it was solved by checking the box "TOas ref pose" under mesh settings when importing.

[Rukasu]

Hey,

I've encountered some problem using leapmotion + player teleportation/rotation.

I am working on a project that uses the oculus, to get a view of the backside we teleport the player to the new location and rotate him 180 degrees, so he looks straigth at the backside of the object.
The problem is, the controller (LeapEchoCollusionCharacter) doesn't rotate with the player. That means the right hand always shows up, but the left hand doesn't. It is positioned behind the player and you have to look at it first in order to be able to use it.

I need a workaround for this, 'cause we can't have it this way.

[Fnordcorps]

Hi Getnamo, thanks for your plugin, we have had it working brilliantly. I was wondering if you are planning to update to 4.11 anytime soon? Unfortunately - trying and failing to be clever and 'future proof' we decided to build our project in 4.11 and now we want to integrate leap motion UE4 throws up a load of errors when we try to put the plugin in our project. Screenshots of the errors attached if they are of any help to you. thanks again!