Announcement

Collapse
No announcement yet.

Kinect 4 Windows v2.0 Plugin

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Kinect 4 Windows v2.0 Plugin



    Important! Read First!
    Disclaimer:
    The Kinect for Windows V2 hardware and software described here are preliminary and subject to change.

    Compatibility:

    1) This plugin is designed for Kinect for Windows V2 and can be compiled only by participants of Microsoft's Kinect4Windows Developer preview program with properly installed SDK.
    2) It is not backward compatible to the Kinect 4 Windows V1 and XBOX 360 Kinect!

    Kinect 4 Windows V2 SDK:
    1) This plugin does not include the Kinect 4 Windows V2 SDK and K4WLib assumes that you have it installed.
    2) Please do not ask for the SDK because I cannot redistribute it (see Compatibility note 1).


    Hello all!

    So the moment I found out that UE4 is out and went over the code I knew that the potential for serious Kinect game is amazing!
    Fortunately I participate in the developer preview program for the windows version of the Xbox One Kinect
    So I started hacking at it!

    For now I was able to hook into the input device system and open a connection to the sensor from inside the UE.

    Repos:

    4.1

    4.2



    Demos:

    Prebuilt

    Editor Project

    UPDATES:

    Fully functional

    Work in progress

    Does not function


    Upcoming update:

    1) No more custom engine build!
    The plugin framework is now based on IInputDeviceModule that means that it is now a true plugin.


    2) One editor to rule them all!
    From the next update if you want Kinect in your game you don't need to go into C++ at all!
    That means that no more recompiling and overriding functions all you'll need to receive Kinect events is to add kinect listener inrerface to any blueprint you want and you will get instantly a Kinect event in that blueprint!


    3) If the kinect can recognize track hand states why can't I see it on my model?
    Well the update will include an animation node adding the ability to blend animations with the kinect controlled avatar!
    So now if you close or open your hand the model will too!


    4) Who said that if you stand in one spot in your room you should stay in the same place in game?
    The update will include body joystick! Want to go back and forward just lean forward or back! If you want to strafe just lean to the sides!
    And if you want to turn? No problem! Use your shoulders as a steering wheel!


    17/5/14

    Added color,depth and infrared stream interfaces

    Latest update

    Last edited by lion032; 05-21-2014, 08:08 AM.

  • #2
    Nice, I hope that with the source code being available that Kinect will be able to have a high level of integration.

    Hopeing for the ability to use Kinect 2.0 + Oculus Rift

    Comment


    • #3
      Originally posted by lion032 View Post
      Hello all!

      For now I was able to hook into the input device system and open a connection to the sensor from inside the UE.

      Hi,
      That was pretty quick work! I too am part of the Kinect V2 preview program and am also using the Kinect for use with the Oculus rift. I've had great results in Unity, but it looks like it's time to port to Unreal.

      Can you tell me the steps you too to get access to the device from within Unreal Engine (or maybe have any sample code)? I've got some ideas (maybe a plugin), but I'm not sure where to start.

      Comment


      • #4
        I'm setting up a github repo I'll share my code there.

        https://github.com/lion03/UnrealEngine
        Last edited by lion032; 03-21-2014, 05:36 PM.

        Comment


        • #5
          This is relevant to my interests.

          Thank you.

          If only I had a Kinect2 for Windows...
          Rule#21: Be polite, be professional, but have a plan to kill everyone you meet.

          Comment


          • #6
            I am implementing it with the option of easy addition of other NUI sensors.

            Comment


            • #7
              I expect to get my Kinect 2 sensor soon, and will be very interested in the integration so keep us posted please
              Sr. Programmer @ CCP Games, Working on VR game "Sparc" (prev. EVE: Valkyrie) | @SiggiGG
              Check out my procedural mesh examples

              Comment


              • #8
                Ok, some progress reports

                I have decided to go around the input system and add my own due to the limitations of the input system.
                Also it took me a while but I finally figured out how the threading system works and hopefully the data pooling from the sensor would be in it's own thread.

                Comment


                • #9
                  Originally posted by lion032 View Post
                  Ok, some progress reports

                  I have decided to go around the input system and add my own due to the limitations of the input system.
                  Also it took me a while but I finally figured out how the threading system works and hopefully the data pooling from the sensor would be in it's own thread.
                  Hey, thanks for posting your work so far with the Kinect plugin. It's been a great help.

                  I am also looking at how the threading works now, do you have any samples/advice on how to get the sensor polling running in it's own thread?

                  Comment


                  • #10
                    I am actually looking into it as we speak.
                    Trying to figure out why the heck the thread I opened doesn't die on shutdown

                    Comment


                    • #11
                      Originally posted by lion032 View Post
                      Hello all!

                      So the moment I found out that UE4 is out and went over the code I knew that the potential for serious Kinect game is amazing!
                      Fortunately I participate in the developer preview program for the windows version of the Xbox One Kinect
                      So I started hacking at it!

                      For now I was able to hook into the input device system and open a connection to the sensor from inside the UE.

                      More updates coming soon!
                      Fantastic, keeps us informed
                      UE4 high res character modelling, rigging for facial and full body animation - HERE
                      Dave Saxon/AKA Lex Luthor Channel
                      Seek And Destroy Games Channel
                      Our Website here.
                      Download free animations here

                      Comment


                      • #12
                        So!

                        Big update!

                        I am almost done! The only thing that is left is to write the dispatcher system.

                        Hopefully It will be ready in the next few days!

                        Comment


                        • #13
                          Big like on that
                          Sr. Programmer @ CCP Games, Working on VR game "Sparc" (prev. EVE: Valkyrie) | @SiggiGG
                          Check out my procedural mesh examples

                          Comment


                          • #14
                            want a bigger like?
                            About a minute ago I got it to work

                            Managed to automatically initiate the sensor in it's own thread.
                            Build event dispatching system that is automatically manages listeners.
                            And the most important thing is that a game character is actually receives body tracking data.

                            the code is still really dirty but if you want I can share it

                            Comment


                            • #15
                              News is supposedly the Windows version of Kinect 2.0 isn't far from being released.

                              Comment

                              Working...
                              X