[Plugin] Leap Motion - Event Driven

[bullale]

Hi,

I tried running the plugin in UE4.5 and I get message:
The following modules are missing or build with a different engine version:
UE4Editor-LeapMotion.dll
Would you like to rebuild them now?

I have the same problem as BartBarlowski.

I'm on Win 8.1 x64. My Editor is built from source. It says it is version 4.5.1. Anytime I add your folders to a project I can no longer open that project because of the above error.
I'm now downloading the Engine provided by the launcher (4.5.0). I'll let you know if that makes a difference.

However, the better solution would be if I could build the plugin myself. Can you please provide instructions on how to do that?

Thank you!

[getnamo]

Hi Getnamo.

Great work on the plugin. Is there an example blueprint for using the skeletal mesh of the hero character instead of the debug spheres?

Thanks

See the hydra thread where we've talked about inverse kinematics to set this up for hands/arms. It is not a trivial topic, so ensure you understand how the unreal engine animation system works, essentially you just forward your leap motion positions to IK nodes (or FK rotations) in the animation graph, refer to IK setup documentation and animation documentation in general for details.

[Synesthesia]

Hi Getnamo.

Great work on the plugin. Is there an example blueprint for using the skeletal mesh of the hero character instead of the debug spheres?

Thanks

[getnamo]

Updated the image for recognizing gestures which reflects the new property based setup. With the latest plugin version, just follow this graph:

[Joe1029]

Has anyone been able to get the gesture sample hooked up? I can't find where "TYPE" is. I would really appreciate any help.

[Joe1029]

Lol dude I just updated the plug in today!

[getnamo]

Thanks for this great tool guys! I hope to contribute to the thread in a few weeks.
Anyone have graphic card recommendations for best hmd/ue4/leap usage. I am still organizing myself for leap integration as my leap doesnt arrive for hmm well maybe tomorrow!
Has anyone had any luck getting the raw images into ue4?
Cant wait to share my project! Thanks again.

Get a high-end gpu as VR is demanding, if you can afford it a 980gtx if not a 970gtx is currently the best sweet spot.

Its also your lucky day, just updated to 0.7 which adds....

Leap Image API
Drag out nodes like this to obtain an image


Which gives the following left image.



For demonstration purposes the distortion map is also shown on the right. See the github repo and Leap Documentation for more details.

The image is stable and real-time due to my texturing method containing no extra copies. The next step will be warping this around your head and trying to get something similar to VR Intro... but that may take some time, until then tinker away!

Hey Getnamo where do I get "TYPE" from? It's not in my library. I tried making an enum variable but couldnt connect it like you have it in the images.

The plugin has been pretty active of late, some of those nodes have changed into properties but their names should be the same. Just make sure you start dragging out from the colored node (the object) not the execution node, from there just typing 'Leap' will narrow you execution choices to the ones relevant to the plugin.

[Joe1029]

Hey Getnamo where do I get "TYPE" from? It's not in my library. I tried making an enum variable but couldnt connect it like you have it in the images.

[rasamaya]

Thanks for this great tool guys! I hope to contribute to the thread in a few weeks.
Anyone have graphic card recommendations for best hmd/ue4/leap usage. I am still organizing myself for leap integration as my leap doesnt arrive for hmm well maybe tomorrow!
Has anyone had any luck getting the raw images into ue4?
Cant wait to share my project! Thanks again.

[getnamo]

Update to 0.6.4
-Fixed lack of categorization caused by updates in some of the blueprints classes
-Cleaned up a lot of the blueprint functions, turning all the relevant
ones into properties. This will reduce the number of execution pins.
-Things which return a new object generally remain a function for
potential performance reasons

... Also I can only bring up stabilizedPalmPosition and stabilizedTipPosition, not palmPosition or tipPosition, I'm assuming you updated those nodes. Just thought I should mention...

Yeah something I did in the earlier updates changed the blueprint categorization. I went through each blueprint class in the plugin and changed a lot of them into properties which should reduce the execution pin requirements.

With the change I updated the quick setup and debug hand images which include each finger bone giving you something like this:



Grab the updated plugin (0.6.4) and check at the begining of the thread for the updated API example.

Thanks for the quick reply. I'm on Win64. Downloaded the latest plugin and UE4.5. Unfortunately I can't get to the editor (it just stops loading when the "The following modules are missing or build with a different engine version: UE4Editor-LeapMotion.dll Would you like to rebuild them now?" so I did not get to test it with play. Am I missing something?

That error simply means your project is not in UE4.5, make sure to switch the engine version or create a new 4.5 project. I updated the plugin again, this time it was tested on a fresh no-code project and I confirmed it worked. Try re-downloading the latest plugin and start from the beginning.

[Joe1029]

Hey getnamo I'm putting the BP together but I noticed that I dont have a debug sphere at actor I can only bring up Draw Debug Sphere. Does that matter? Also I can only bring up stabilizedPalmPosition and stabilizedTipPosition, not palmPosition or tipPosition, I'm assuming you updated those nodes. Just thought I should mention.

UPDATE: Nevermind debug sphere at actor is a custom function that I didn't scroll down far enough thank you though. I'm a newb so could you push me in the direction of adding actual bones to this system? Thanks getnamo! great job!!!

[BartBarlowski]

Ensure you're on Win64, make sure you download the latest plugin version (0.6.3) this is compiled for UE4.5. When you play hit play not launch. If you want to run it outside the editor use Play->Standalone Game. If you want to package/cook and test for shipping, read the shipping instructions.

Thanks for the quick reply. I'm on Win64. Downloaded the latest plugin and UE4.5. Unfortunately I can't get to the editor (it just stops loading when the "The following modules are missing or build with a different engine version: UE4Editor-LeapMotion.dll Would you like to rebuild them now?" so I did not get to test it with play. Am I missing something?

[getnamo]

Hi,

I tried running the plugin in UE4.5 and I get message:
The following modules are missing or build with a different engine version:
UE4Editor-LeapMotion.dll
Would you like to rebuild them now?

When I click yes, it fails to compile.
I copied Binaries and Plugin folders to the root of the project.
I also tried the 4.4 version fo the plugin and get a diffrent message
"Plugin 'LeapMotion' failed to load because module LeapMotion' could be loaded...'

Any help will be much appreciated, I'm completly stuck!

Ensure you're on Win64, make sure you download the latest plugin version (0.6.3) this is compiled for UE4.5. When you play hit play not launch. If you want to run it outside the editor use Play->Standalone Game. If you want to package/cook and test for shipping, read the shipping instructions.

[BartBarlowski]

Hi,

I tried running the plugin in UE4.5 and I get message:
The following modules are missing or build with a different engine version:
UE4Editor-LeapMotion.dll
Would you like to rebuild them now?

When I click yes, it fails to compile.
I copied Binaries and Plugin folders to the root of the project.
I also tried the 4.4 version fo the plugin and get a diffrent message
"Plugin 'LeapMotion' failed to load because module LeapMotion' could be loaded...'

Any help will be much appreciated, I'm completly stuck!

[getnamo]

Update to 0.6.3
-Changed plugin to runtime to support shipping builds
-See the github readme for shipping/packaging instructions.

Ok.. so I just tried the updated version of the plugin with UE4.5 and also changed my projects directory to the default path... but now I keep getting this error:
Any ideas?

If its possible it would be really nice to have a sample project to test with to make sure that I have setup everything right

This was happening because of launching v0.6.2 or lower version of the plugin which didn't have packaged/shipping support. Download 0.6.3 plugin or later and see the github readme for shipping/packaging instructions.

Hey, Is there anywhere where I can download an example project? Thanks, Lewis

I don't plan on including an example project as it is two simple steps to include leap support. Follow the how to instructions and you will be up and running in a few minutes.