Announcement

Collapse
No announcement yet.

[Plugin] Leap Motion - Event Driven

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • replied
    Hi Getnamo,

    I'm trying to Control Leap Echo hands Rigged Child Actor's components from My_Character over blueprints . I tried to cast to it just to get the Left hand Mesh :

    Click image for larger version

Name:	002.JPG
Views:	1
Size:	93.0 KB
ID:	1103707

    But this always get failed , Am I doing something wrong ?!

    Leave a comment:


  • replied
    Originally posted by getnamo View Post
    It's integrated directly in the engine now in 4.11

    http://blog.leapmotion.com/leap-moti...unreal-engine/

    Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

    More thorough documentations on the new stuff incoming over the next few days.
    That's awesome, can't wait for the documentation on the new stuff! Ever since I saw Orion I've been wanting to try it out.

    Also i would like to ask if you could help me out with translating the fingers 3D world position to the widgets local 2D position? Currently I'm taking the rt_middle_a socket position and then using ProjectWorldLocationToWidgetPosition (I've also tried ConvertWorldLocationToScreenLocation which performed worse) to set the cursor image I have in my menu widget using SetPosition with the image as a Canvas Slot and I can get the image to move with the hand, but the image moves at a slower ratio than my hand so If I'm at the edges of my Menu then there's a discrepancy between the finger position and the cursor image's position. Any idea how I can solve it?

    Thanks in advance!
    Last edited by vhung92; 04-01-2016, 06:54 AM.

    Leave a comment:


  • replied
    Originally posted by Rukasu View Post
    Hey,

    I've encountered some problem using leapmotion + player teleportation/rotation.

    I am working on a project that uses the oculus, to get a view of the backside we teleport the player to the new location and rotate him 180 degrees, so he looks straigth at the backside of the object.
    The problem is, the controller (LeapEchoCollusionCharacter) doesn't rotate with the player. That means the right hand always shows up, but the left hand doesn't. It is positioned behind the player and you have to look at it first in order to be able to use it.

    I need a workaround for this, 'cause we can't have it this way.

    Just wanted to say that my Problem solved itself with the new Plugin that comes with 4.11 , great job!

    Leave a comment:


  • replied
    It's integrated directly in the engine now in 4.11

    http://blog.leapmotion.com/leap-moti...unreal-engine/

    Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

    More thorough documentations on the new stuff incoming over the next few days.
    Getnamo you're my hero!

    Leave a comment:


  • replied
    Originally posted by getnamo View Post
    It's integrated directly in the engine now in 4.11

    http://blog.leapmotion.com/leap-moti...unreal-engine/

    Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

    More thorough documentations on the new stuff incoming over the next few days.
    Ah! great! Congratulations.

    Leave a comment:


  • replied
    Originally posted by hcenteno View Post
    OK, it wasn't that difficult. You just need to replace in the source all the SetFlags(RF_RootSet) calls with AddToRoot() and the HasAnyFlags(RF_RootSet) calls with IsRooted() and the plugin compiles. I did a quick test with a new 4.11 project and it seemed to work. Maybe Getnamo can confirm that this is correct and not just a hack.

    Cheers!
    It's integrated directly in the engine now in 4.11

    http://blog.leapmotion.com/leap-moti...unreal-engine/

    Just update your launcher version and enable the plugin. The interface is largely the same as before with a few new convenience characters and image support!

    More thorough documentations on the new stuff incoming over the next few days.
    Last edited by getnamo; 03-31-2016, 01:52 PM.

    Leave a comment:


  • replied
    Originally posted by hcenteno View Post
    The plugin needs to be recompiled for 4.11 but presently that throws a lot of errors. I'm trying to fix them since I do need the plugin working on 4.11 soon. On the other hand, 4.11 final is officially out today so maybe this Leap plugin will now get some 4.11 love from the developers.
    OK, it wasn't that difficult. You just need to replace in the source all the SetFlags(RF_RootSet) calls with AddToRoot() and the HasAnyFlags(RF_RootSet) calls with IsRooted() and the plugin compiles. I did a quick test with a new 4.11 project and it seemed to work. Maybe Getnamo can confirm that this is correct and not just a hack.

    Cheers!
    Last edited by virtualHC; 03-31-2016, 12:34 PM.

    Leave a comment:


  • replied
    Originally posted by Fnordcorps View Post
    Hi Getnamo, thanks for your plugin, we have had it working brilliantly. I was wondering if you are planning to update to 4.11 anytime soon? Unfortunately - trying and failing to be clever and 'future proof' we decided to build our project in 4.11 and now we want to integrate leap motion UE4 throws up a load of errors when we try to put the plugin in our project. Screenshots of the errors attached if they are of any help to you. thanks again!
    The plugin needs to be recompiled for 4.11 but presently that throws a lot of errors. I'm trying to fix them since I do need the plugin working on 4.11 soon. On the other hand, 4.11 final is officially out today so maybe this Leap plugin will now get some 4.11 love from the developers.

    Cheers!

    Leave a comment:


  • replied
    Im am making a multiplayer game with leap motion however the hands of all players respond to the input of just one player, how can I fix this and make it individual to the client.

    For example, I have my game running on two computers and when I put my hands in front of my face while on client 1, client 2's player does the exact samething. It only does this for the leap input, using wasd to move is indeed isolated to the individual clients as it should be.

    Leave a comment:


  • replied
    Can i create custom gestures with this plugin?

    Leave a comment:


  • replied
    I got a Problem with Changing the Parent Class of "Leap Basic Rigged Character" from Character(C++) to Spectator Pawn(C++). I just assigned everything exactly the same as before after Reparenting but Ingame my hands are not controlling the Skeletal mesh. Did I miss something here ?! I really don't want my movement class to be Character, so have to change it to get 6-DOF kind of navigation.

    Leave a comment:


  • replied
    Originally posted by getnamo View Post
    This might be a load order problem, see if changing the load order inside https://github.com/getnamo/leap-ue4/...Motion.uplugin would solve that (try predefault).
    Hey getnamo, thanks for the reply! I tried adding the line
    "LoadingPhase": "PreDefault"
    but I still have the same issue. The workaround is not really hindering me in any way and I would like to ask another question regarding the Leap and UMG.

    I would like to have Leap interaction with a 3D menu that I have. I've managed to attach the menu to my custom leap character (subclassing LeapCollisionCharacter) because I want the menu to follow the camera movements of the user as shown below:


    However, I'm not entirely sure where to start in order to get the menu to interact with the hand. I found this link https://answers.unrealengine.com/que...or-3d-umg.html where you said you are using the same hack but I'm guessing instead of using the mouse position you use the hand position translated to (x,y) that you described here. Is it possible for you to put up the blueprint you were using or a tutorial on how to dit?

    EDIT: I've tried first by adding OnComponentBeginOverlap(menu) as well as adding a box collider and using OnComponentBeginOverlap(box) to just print the location of the hit (breaking the hit result) but it's not generating any overlap events.


    EDIT2: So I figured out what was wrong, I had forgotten to enable "Generate Overlap Events" on the hand meshes and I can now get events when the hand overlaps with the menu widget, Now I'm looking at translating the 3d world location of the hand to the widgets local space as well as calling functions on the menu widget.


    Thanks in advance!
    Attached Files
    Last edited by vhung92; 03-24-2016, 09:24 AM.

    Leave a comment:


  • replied
    Originally posted by getnamo View Post
    I think that the right place should still be https://github.com/getnamo/leap-ue4/...aceUtility.cpp. E.g. multiplying the UE_TO_LEAP_SCALE by w2m inside the code, will try this approach next time I do a plugin pass.
    Everything works now! This is what solves it in the function convertAndScaleLeapToUE:
    float w2m = GWorld->GetWorldSettings()->AWorldSettings::WorldToMeters / 100.0f;
    FVector vect = FVector(-leapVector.z * LEAP_TO_UE_SCALE * w2m, leapVector.x * LEAP_TO_UE_SCALE * w2m, leapVector.y * LEAP_TO_UE_SCALE * w2m);

    this is something i tried at first but the thing i missed was that the size of the hand meshes has to be scaled with the same factor (w2m). So I just exported your hands to blender, scaled them and then reimported them and force replaced the old hands_lo and its skeleton with the new. I got a weird orientation error but it was solved by checking the box "TOas ref pose" under mesh settings when importing.
    Last edited by Ders92; 03-21-2016, 11:02 AM.

    Leave a comment:


  • replied
    Hey,

    I've encountered some problem using leapmotion + player teleportation/rotation.

    I am working on a project that uses the oculus, to get a view of the backside we teleport the player to the new location and rotate him 180 degrees, so he looks straigth at the backside of the object.
    The problem is, the controller (LeapEchoCollusionCharacter) doesn't rotate with the player. That means the right hand always shows up, but the left hand doesn't. It is positioned behind the player and you have to look at it first in order to be able to use it.

    I need a workaround for this, 'cause we can't have it this way.

    Leave a comment:


  • replied
    Hi Getnamo, thanks for your plugin, we have had it working brilliantly. I was wondering if you are planning to update to 4.11 anytime soon? Unfortunately - trying and failing to be clever and 'future proof' we decided to build our project in 4.11 and now we want to integrate leap motion UE4 throws up a load of errors when we try to put the plugin in our project. Screenshots of the errors attached if they are of any help to you. thanks again!

    Click image for larger version

Name:	Leap1.PNG
Views:	1
Size:	38.6 KB
ID:	1102796
    Click image for larger version

Name:	Leap2.PNG
Views:	1
Size:	48.0 KB
ID:	1102797
    Click image for larger version

Name:	Leap3.PNG
Views:	1
Size:	79.0 KB
ID:	1102798

    Leave a comment:

Working...
X