So the moment I found out that UE4 is out and went over the code I knew that the potential for serious Kinect game is amazing!
Fortunately I participate in the developer preview program for the windows version of the Xbox One Kinect
So I started hacking at it!
For now I was able to hook into the input device system and open a connection to the sensor from inside the UE.
**1) No more custom engine build!
The plugin framework is now based on IInputDeviceModule that means that it is now a true plugin. **
2) One editor to rule them all!
From the next update if you want Kinect in your game you don’t need to go into C++ at all!
That means that no more recompiling and overriding functions all you’ll need to receive Kinect events is to add kinect listener inrerface to any blueprint you want and you will get instantly a Kinect event in that blueprint!
3) If the kinect can recognize track hand states why can’t I see it on my model?
Well the update will include an animation node adding the ability to blend animations with the kinect controlled avatar!
So now if you close or open your hand the model will too!
**4) Who said that if you stand in one spot in your room you should stay in the same place in game?
The update will include body joystick! Want to go back and forward just lean forward or back! If you want to strafe just lean to the sides!
And if you want to turn? No problem! Use your shoulders as a steering wheel! **
That was pretty quick work! I too am part of the Kinect V2 preview program and am also using the Kinect for use with the Oculus rift. I’ve had great results in Unity, but it looks like it’s time to port to Unreal.
Can you tell me the steps you too to get access to the device from within Unreal Engine (or maybe have any sample code)? I’ve got some ideas (maybe a plugin), but I’m not sure where to start.
I have decided to go around the input system and add my own due to the limitations of the input system.
Also it took me a while but I finally figured out how the threading system works and hopefully the data pooling from the sensor would be in it’s own thread.
want a bigger like?
About a minute ago I got it to work
Managed to automatically initiate the sensor in it’s own thread.
Build event dispatching system that is automatically manages listeners.
And the most important thing is that a game character is actually receives body tracking data.
the code is still really dirty but if you want I can share it