[Plugin] Leap Motion - Event Driven

[Joe1029]

Lol dude I just updated the plug in today!

[getnamo]

Thanks for this great tool guys! I hope to contribute to the thread in a few weeks.
Anyone have graphic card recommendations for best hmd/ue4/leap usage. I am still organizing myself for leap integration as my leap doesnt arrive for hmm well maybe tomorrow!
Has anyone had any luck getting the raw images into ue4?
Cant wait to share my project! Thanks again.

Get a high-end gpu as VR is demanding, if you can afford it a 980gtx if not a 970gtx is currently the best sweet spot.

Its also your lucky day, just updated to 0.7 which adds....

Leap Image API
Drag out nodes like this to obtain an image


Which gives the following left image.



For demonstration purposes the distortion map is also shown on the right. See the github repo and Leap Documentation for more details.

The image is stable and real-time due to my texturing method containing no extra copies. The next step will be warping this around your head and trying to get something similar to VR Intro... but that may take some time, until then tinker away!

Hey Getnamo where do I get "TYPE" from? It's not in my library. I tried making an enum variable but couldnt connect it like you have it in the images.

The plugin has been pretty active of late, some of those nodes have changed into properties but their names should be the same. Just make sure you start dragging out from the colored node (the object) not the execution node, from there just typing 'Leap' will narrow you execution choices to the ones relevant to the plugin.

[Joe1029]

Hey Getnamo where do I get "TYPE" from? It's not in my library. I tried making an enum variable but couldnt connect it like you have it in the images.

[rasamaya]

Thanks for this great tool guys! I hope to contribute to the thread in a few weeks.
Anyone have graphic card recommendations for best hmd/ue4/leap usage. I am still organizing myself for leap integration as my leap doesnt arrive for hmm well maybe tomorrow!
Has anyone had any luck getting the raw images into ue4?
Cant wait to share my project! Thanks again.

[getnamo]

Update to 0.6.4
-Fixed lack of categorization caused by updates in some of the blueprints classes
-Cleaned up a lot of the blueprint functions, turning all the relevant
ones into properties. This will reduce the number of execution pins.
-Things which return a new object generally remain a function for
potential performance reasons

... Also I can only bring up stabilizedPalmPosition and stabilizedTipPosition, not palmPosition or tipPosition, I'm assuming you updated those nodes. Just thought I should mention...

Yeah something I did in the earlier updates changed the blueprint categorization. I went through each blueprint class in the plugin and changed a lot of them into properties which should reduce the execution pin requirements.

With the change I updated the quick setup and debug hand images which include each finger bone giving you something like this:



Grab the updated plugin (0.6.4) and check at the begining of the thread for the updated API example.

Thanks for the quick reply. I'm on Win64. Downloaded the latest plugin and UE4.5. Unfortunately I can't get to the editor (it just stops loading when the "The following modules are missing or build with a different engine version: UE4Editor-LeapMotion.dll Would you like to rebuild them now?" so I did not get to test it with play. Am I missing something?

That error simply means your project is not in UE4.5, make sure to switch the engine version or create a new 4.5 project. I updated the plugin again, this time it was tested on a fresh no-code project and I confirmed it worked. Try re-downloading the latest plugin and start from the beginning.

[Joe1029]

Hey getnamo I'm putting the BP together but I noticed that I dont have a debug sphere at actor I can only bring up Draw Debug Sphere. Does that matter? Also I can only bring up stabilizedPalmPosition and stabilizedTipPosition, not palmPosition or tipPosition, I'm assuming you updated those nodes. Just thought I should mention.

UPDATE: Nevermind debug sphere at actor is a custom function that I didn't scroll down far enough thank you though. I'm a newb so could you push me in the direction of adding actual bones to this system? Thanks getnamo! great job!!!

[BartBarlowski]

Ensure you're on Win64, make sure you download the latest plugin version (0.6.3) this is compiled for UE4.5. When you play hit play not launch. If you want to run it outside the editor use Play->Standalone Game. If you want to package/cook and test for shipping, read the shipping instructions.

Thanks for the quick reply. I'm on Win64. Downloaded the latest plugin and UE4.5. Unfortunately I can't get to the editor (it just stops loading when the "The following modules are missing or build with a different engine version: UE4Editor-LeapMotion.dll Would you like to rebuild them now?" so I did not get to test it with play. Am I missing something?

[getnamo]

Hi,

I tried running the plugin in UE4.5 and I get message:
The following modules are missing or build with a different engine version:
UE4Editor-LeapMotion.dll
Would you like to rebuild them now?

When I click yes, it fails to compile.
I copied Binaries and Plugin folders to the root of the project.
I also tried the 4.4 version fo the plugin and get a diffrent message
"Plugin 'LeapMotion' failed to load because module LeapMotion' could be loaded...'

Any help will be much appreciated, I'm completly stuck!

Ensure you're on Win64, make sure you download the latest plugin version (0.6.3) this is compiled for UE4.5. When you play hit play not launch. If you want to run it outside the editor use Play->Standalone Game. If you want to package/cook and test for shipping, read the shipping instructions.

[BartBarlowski]

Hi,

I tried running the plugin in UE4.5 and I get message:
The following modules are missing or build with a different engine version:
UE4Editor-LeapMotion.dll
Would you like to rebuild them now?

When I click yes, it fails to compile.
I copied Binaries and Plugin folders to the root of the project.
I also tried the 4.4 version fo the plugin and get a diffrent message
"Plugin 'LeapMotion' failed to load because module LeapMotion' could be loaded...'

Any help will be much appreciated, I'm completly stuck!

[getnamo]

Update to 0.6.3
-Changed plugin to runtime to support shipping builds
-See the github readme for shipping/packaging instructions.

Ok.. so I just tried the updated version of the plugin with UE4.5 and also changed my projects directory to the default path... but now I keep getting this error:
Any ideas?

If its possible it would be really nice to have a sample project to test with to make sure that I have setup everything right

This was happening because of launching v0.6.2 or lower version of the plugin which didn't have packaged/shipping support. Download 0.6.3 plugin or later and see the github readme for shipping/packaging instructions.

Hey, Is there anywhere where I can download an example project? Thanks, Lewis

I don't plan on including an example project as it is two simple steps to include leap support. Follow the how to instructions and you will be up and running in a few minutes.

[lewisq]

Hey, Is there anywhere where I can download an example project? Thanks, Lewis

[Xeno]

Thank you very much it's working perfectly !! Have a good day !!!

[getnamo]

Ok.. so I just tried the updated version of the plugin with UE4.5 and also changed my projects directory to the default path... but now I keep getting this error:
...
Any ideas?

If its possible it would be really nice to have a sample project to test with to make sure that I have setup everything right

Just did a blank project (no code) test with the currently uploaded 0.6.2 plugin from this page (github download), it worked without problems.

Please ensure you're installing this correctly



Also check that you're using the Windows x64 platform (XP/Vista/7/8 x64), I have not tested this plugin for any other platform and will need to add relevant binaries before it will work. If both of those cases are correct and it is still not working, send me your logs (found in {ProjectRoot}/Saved/Logs)

Hi !! First I want to thank you very much for your plugin I was waiting a lot for that !!
I was wondering if you could explain me if there is a way to allow the hands to follow the same rotation of the character Root (Capsule Component) ? ^^
When i am rotating my character, the hand doesn't rotate :'[
Thank you !

You have to rotate the positions you get from your leap by your control rotation like so


Make sure the order you do this is correct as it will rotate the vector around its origin. In most cases this will be before you convert it to world space.

[Inx51]

Hi,
and thanks for sharing this plugin with us .
However.. I'm currently having a problem with the plugin.. as soon as I add the interface to my controller (MyController) and launches the project I end up with a message saying "Fatal error!" and that the game crashed and the message that's displayed refers to a bunch of addresses and paths (as far as I can tell all the paths do exist).

I have added the Bin and Plugin folders and all the files to my project, and the plugin is enabled.

Im using the latest Leap SDK and UE4.4.3, I have also confirmed that my leap is working with other leap projects.
Im not sure if it matters but Im using Windows 8.1 x64.. if that's helpful in some way .

Any ideas?

Ok.. so I just tried the updated version of the plugin with UE4.5 and also changed my projects directory to the default path... but now I keep getting this error:

Any ideas?

If its possible it would be really nice to have a sample project to test with to make sure that I have setup everything right

[Xeno]

Hi !! First I want to thank you very much for your plugin I was waiting a lot for that !!
I was wondering if you could explain me if there is a way to allow the hands to follow the same rotation of the character Root (Capsule Component) ? ^^
When i am rotating my character, the hand doesn't rotate :'[
Thank you !