Announcement

Collapse
No announcement yet.

[Plugin] Leap Motion - Event Driven

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • replied
    Originally posted by Harry.Kim View Post
    Hi, I'm trying to use it now, and I just downloaded newest version of it, I also successfully see my hands on the screen, however hands on screen is flipped, for example, my thumb movement reflect on the little finger at the screen.
    It would be helpful if I know what reason could make this is happening!
    I found what was the problem. It's related to VR mode. https://developer.leapmotion.com/vr

    Leave a comment:


  • replied
    this plugin is incredible and works great, thanks so much for this integration work!

    Leave a comment:


  • replied
    Hi, I'm trying to use it now, and I just downloaded newest version of it, I also successfully see my hands on the screen, however hands on screen is flipped, for example, my thumb movement reflect on the little finger at the screen.
    It would be helpful if I know what reason could make this is happening!

    Leave a comment:


  • replied
    Originally posted by Tony Tong View Post
    Hi there, just try your plug-in and it was awesome!! By the way I've tried with Oculus VR and something get weird. Hands&arms are reversed display (I move right hand, the left one in VR move). Also if I want to use only the arm detecting (freezing fingers/hands) will I be able to do it with your plug-in?

    P.S. I'm really new to UE, please spare me if I know too little, Thank you.
    If you're using the rigged content, then hands reversal may be due to initial wrong guess by the leap software. Hide and show your hands again and it will typically get them right. If you're using a custom approach on the other hand, remember that you need to enable HMD mode (Optimize for HMD and auto-shift and auto-rotate) in order for the hands to appear correctly. Rigged content automatically adjusts this.

    Regarding arm detection, you can query Arm location from the 'Hand Moved' event and only use that to track your characters movements.

    Originally posted by knack View Post
    some progress in the finger rotation fix?
    Not yet, will take a look at this when I get some time :/

    Originally posted by ppaolell View Post
    Hi All,

    I'm wondering if anyone else is having a problem with gestures? I'm using "Event Hand Grabbed" and it seems like the leap only registers the gesture about half of the time, and only if the hands are located in a very specific location relative to the leap. I'm not sure if it's the leap itself, or something specific to my project or this plugin. Does anybody else have this problem, or know of a fix for it?

    Thanks,
    Pat
    Leap software may have issues detecting a grabbing gesture when your hand is facing away. If you're finding a specific location causes a problem, try to make a video of it and it will be easier to find the root cause.

    Leave a comment:


  • replied
    Hi there, just try your plug-in and it was awesome!! By the way I've tried with Oculus VR and something get weird. Hands&arms are reversed display (I move right hand, the left one in VR move). Also if I want to use only the arm detecting (freezing fingers/hands) will I be able to do it with your plug-in?

    P.S. I'm really new to UE, please spare me if I know too little, Thank you.

    Leave a comment:


  • replied
    some progress in the finger rotation fix?

    Leave a comment:


  • replied
    Hi All,

    I'm wondering if anyone else is having a problem with gestures? I'm using "Event Hand Grabbed" and it seems like the leap only registers the gesture about half of the time, and only if the hands are located in a very specific location relative to the leap. I'm not sure if it's the leap itself, or something specific to my project or this plugin. Does anybody else have this problem, or know of a fix for it?

    Thanks,
    Pat

    Leave a comment:


  • replied
    Originally posted by mankindforward View Post
    Yes, I'm doing this on two separate computers. Two of everything, connecting over LAN. Movements are replicated properly, meaning Player 1 can move and Player 2 sees the him move. I'll keep digging but it sounds like this *should* work. Have you tested this scenario yourself? Or anybody else tried this? Perhaps I'm missing some configuration.
    Interesting. I do not have 2 leaps to replicate what you're doing, but based on my experience with networking you can choose specifically what should replicate and what shouldn't. You may be doing full actor replication instead of variable replication.

    If you use variable replication with hand/finger positions (e.g. AnimBody) then downstream they should affect the 2nd client only as expected. There are various approaches to what information gets updated over a network. A good primer on blueprint networking can be found here: https://www.youtube.com/watch?v=TbaOyvWfJE0

    Originally posted by Rasa View Post
    Needed your help how could I convert that mouse pointer to down direction and also I don't want camera to follow that mouse pointer
    You probably want to do an raycast originating from the hand's position in the negative Z axis. This would achieve what you're looking for

    Originally posted by Rasa View Post
    How could we do that Hand alone[Without character attached] for Leap motion.
    Already answered earlier.


    Originally posted by aretoon View Post
    Hey Getnamo,

    I just wanted to see if you could give me some direction on what I'm trying to do with your plug in. I want to assign custom functions to basic gestures. I.E. Swiping and rotating an object, pinching to zoom, or controlling the translation of an object by forming a fist and moving it. The goal is to utlize leap motion in showcasing products and having customers interact with it.

    I don't know if there are readily available sources for this, and as a beginner, I sometimes get extremely confused. How should I go about doing this? Where do I start experimenting? Which blueprint are the edits supposed to be done under? If you could give me your opinion as to how to do something similar and tell me the logic behind it I would really be grateful.

    Amazing job as always!
    Cheers,
    Artun
    You probably want to use the Swipe Gesture recognizer in a similar manner to



    See the github repo for more detailed documentation.

    Originally posted by Beunn View Post
    Hey Getnamo,

    Thanks for this amazing plugin !

    Can you tell me how to use it with C++ code ? (Listener with events, Controller...)

    Cheers,
    Beunn
    It would be similar to how its shown in the hydra plugin video with the main difference that you would add a leap component instead of a delegate subclass (leap plugin doesn't have this format) and you would set the interface to receive events via https://wiki.unrealengine.com/Interfaces_in_C%2B%2B.

    Originally posted by iparra View Post
    Hi all,

    I have been experimenting with the latest Leap Motion SDK, and the VR widgets in Unity.

    Here is the link:

    http://blog.leapmotion.com/introduci...lements-unity/

    Here is a video I recorded in Youtube: ...

    Hope we could see this kind of things in UE4 soon with Leap Motion. What do you think Getnamo??

    Cheers.
    These are great things, nothing is stopping you all from adding these kinds of widgets to the plugin, looking forward to seeing these things being tried.

    Originally posted by EVRTOP View Post
    How to put the reality of hand display
    The Passthrough effect seen iparra's video is being worked on however it is not yet ready for the plugin (need to solve 32bit textures first).

    Originally posted by Ittiam View Post
    Hi All,

    I am using a blueprint with Pawn as its parent class. I observe that the hand can be moved over a very limited space in the viewport. What is wrong? How to make the movement cover the whole viewport? Please help.
    See this post where we discuss how to change the origin of the leap in default mode.

    Leave a comment:


  • replied
    Hi All,

    I am using a blueprint with Pawn as its parent class. I observe that the hand can be moved over a very limited space in the viewport. What is wrong? How to make the movement cover the whole viewport? Please help.

    Leave a comment:


  • replied
    Hi all,


    I have been experimenting with the latest Leap Motion SDK, and the VR widgets in Unity.

    Here is the link:

    http://blog.leapmotion.com/introduci...lements-unity/



    Here is a video I recorded in Youtube:


    Hope we could see this kind of things in UE4 soon with Leap Motion. What do you think Getnamo??


    Cheers.

    Leave a comment:


  • replied
    Hey Getnamo,

    Thanks for this amazing plugin !

    Can you tell me how to use it with C++ code ? (Listener with events, Controller...)

    Cheers,
    Beunn

    Leave a comment:


  • replied
    Hey Getnamo,

    I just wanted to see if you could give me some direction on what I'm trying to do with your plug in. I want to assign custom functions to basic gestures. I.E. Swiping and rotating an object, pinching to zoom, or controlling the translation of an object by forming a fist and moving it. The goal is to utlize leap motion in showcasing products and having customers interact with it.

    I don't know if there are readily available sources for this, and as a beginner, I sometimes get extremely confused. How should I go about doing this? Where do I start experimenting? Which blueprint are the edits supposed to be done under? If you could give me your opinion as to how to do something similar and tell me the logic behind it I would really be grateful.

    Amazing job as always!
    Cheers,
    Artun

    Leave a comment:


  • replied
    Originally posted by Rasa View Post
    Hi Getnamo,

    Awesome Plugin, I got it works well and what I'm trying to do is ' walk through by hand gestures[Palm Pitch and Yaw] in Leap Motion' ,
    Now grab the Physics object using hand fingers and Placing it in desired position.
    Is there any reference to this or give some suggestions to do this. I'm Totally newbie to Unreal and blueprint
    Hi Getnamo.

    Finally I did some what with the help of this link now I can control Plus symbol[Mouse pointer] by left hand and pick the Physics object by LeapLeftPinch and Walkthrough is controlled by right hand. It is very difficult that picking the Physics object at the same time controlling the mouse pointer[Leap Yaw and Pinch gesture] in same left hand. So I planned if that mouse pointer is facing to down direction and it will move automatically if hand will move, is very easy to move on after picking the object.

    What I did is
    Click image for larger version

Name:	HP.jpg
Views:	1
Size:	258.1 KB
ID:	1065462
    I'm expecting
    Click image for larger version

Name:	MP.jpg
Views:	1
Size:	444.6 KB
ID:	1065463
    Needed your help how could I convert that mouse pointer to down direction and also I don't want camera to follow that mouse pointer
    How could we do that Hand alone[Without character attached] for Leap motion.

    Cheers...

    Leave a comment:


  • replied
    Originally posted by knack View Post
    anyone update to the last update? break something?
    Originally posted by Lord_Pall View Post
    Well, in 4.7 it doesn't compile .
    c:\projects\unrealengine\engine\intermediate\build\win64\inc\plugins\leapmotion\LeapHand.generated.h(18): error C4099: 'FMatrix' : type name first seen using 'class' now seen using 'struct'C:\projects\UnrealEngine\Engine\Intermediate\Build\Win64\Inc\Plugins\LeapMotion\LeapHand.generated.h(18) : error C4099: 'FMatrix' : type name first seen using 'class' now seen using 'struct'
    Originally posted by iparra View Post
    Lord_Pall, you can compile it, simply replace FMatrix as a class.
    To elaborate a little more on what iparra said...

    The first time you try to compile for a new target it will generate the headers, and the generated headers have the error. You can simply edit the generated headers and change the word "struct" to "class" on the problematic line. However, this does not work if you are packaging from within the editor because the headers are generated anew every time.

    This error comes from the implementation of
    Code:
    FMatrix ULeapHand::RotationMatrix(const ULeapFrame *frame)
    in
    Code:
    Plugins\LeapMotion\Source\LeapMotion\Private\LeapHand.cpp
    If you comment out that whole function, and the function declaration in the header (i.e. Public\LeapHand.h), then the error goes away. Of course that also means you can't access the hand's RotationMatrix anymore. For me this is OK (I only want position), but I guess this would be unacceptable for most.

    Leave a comment:


  • replied
    Lord_Pall, you can compile it, simply replace FMatrix as a class.

    Leave a comment:

Working...
X