Kinect 4 Windows v2.0 Plugin

I can make it work with previous version (with interface) but new version doesn’t work.
I did basically the same thing.
Is there any example?

Thanks

Hi all, post here since I think this plugin might be the right tool for my project.

I’m not a developer, in fact I have a really little experience on game engine.

For a ballet company we wanted to create interactive graphics effects, something like this

(look especially after min 5:27)

but less invasive with subtle touch to add emotion to performance.

Question is how difficult it’s to achieve all of this on UE + Kinect 2 + plugin. I want mostly concentrate on artistic side of the project.

How much programming skills will I need to develop something like this? There is some previous experience someone can share on UE? Will in case find support?

[=davide445;138783]
Hi all, post here since I think this plugin might be the right tool for my project.

I’m not a developer, in fact I have a really little experience on game engine.

For a ballet company we wanted to create interactive graphics effects, something like this

(look especially after min 5:27)

but less invasive with subtle touch to add emotion to performance.

Question is how difficult it’s to achieve all of this on UE + Kinect 2 + plugin. I want mostly concentrate on artistic side of the project.

How much programming skills will I need to develop something like this? There is some previous experience someone can share on UE? Will in case find support?
[/]

Hi !

This plugin is designed for non programmers and programs alike.
All of the Kinect features are accessible through the blueprint system so zero c++ knowledge needed.

[=;138797]
Hi !

This plugin is designed for non programmers and programs alike.
All of the Kinect features are accessible through the blueprint system so zero c++ knowledge needed.
[/]

Thanks , this is really a good news!
Do you think will be easy to create at least basic effects such as fog being attracted from hands of the dancers, and will finally glow? Or also human form made of light that will move in syncro with dancers?

[=;138726]
The bone transform can be accessed by iterating through the Kinect bone array and extracting the joint transform of the Kinect bone struct
[/]

That being said, there’s a bug that I don’t understand. When you do a Kinect Break Body, the values for the array BoneTransforms are not updated in blueprints.
But when I debug in C++, I can see that they are being updated. And like you say, when we get them from the kinect bones (which is what the C++ is doing), we also get the values.

Thanks for the update !
Losing the custom joint struct was a good idea.

Another question: will be possible to use more than one Kinect, to be sure to capture performers rotation?
I will need to capture movements of 5-8 performers on stage, dancing classic ballet.

davide445 : even if it’s “just” Blueprints, you need programming skills to use all that. Blueprints are just a fancy way of displaying code but the logic behind it is the same.
As for multiple Kinects, it’s possible but it’s complicated. You will need multiple computers (one per Kinect) networked.

[=BZysberg;144272]
davide445 : even if it’s “just” Blueprints, you need programming skills to use all that. Blueprints are just a fancy way of displaying code but the logic behind it is the same.
As for multiple Kinects, it’s possible but it’s complicated. You will need multiple computers (one per Kinect) networked.
[/]

Thanks for the warning, this is important.
As for multiple Kinect I will carefully review if we really need this conf.
About programming I have had experience into scientific C programming (from my past degree in computational physics) and most recently in Matlab for finance (from my master in business), but no object oriented programming.
If I need to animate something such as this one http://youtu.be/maEyV0MacpM, what kind of code need I to write?
If it’s algorithm I can possibly do that from my scientific background, and maybe leave to others the more IT-specific work of organizing the classes structure.

You need some basics of object oriented programming because that’s how Blueprints work.
You probably also need to learn how to write shaders to do that kind of effects.
And you need some heavy knowledge on how a 3d engine works.

[=BZysberg;146920]
You need some basics of object oriented programming because that’s how Blueprints work.
You probably also need to learn how to write shaders to do that kind of effects.
And you need some heavy knowledge on how a 3d engine works.
[/]

Reading all of this appear to me the whole project it’s a bit too ambitious for me.
Will evaluate how much will me cost to receive qualified consulting, anyway will be probably cheaper (even if not so effective) to start with a more simple video projection with maybe particle and chroma key effects.
Will see what proposal will come from the 3d artist I’ve contacted in the past week.

Exciting things coming for Kinect Plugin :slight_smile: He has been very busy.

Briefly talked to () and got him connected with some member of epic staff member.

For those that didnt see Kinect + Animations will work now!
https://www…com/watch?v=jtfk_XVreF8&feature=youtu.be

Give Lion a follow on twittertwitter.com/
Great work man and look forward to playing around with some of the changes!

Hey all!

I want to thank and Epic devs for their help!

I have an exciting new feature to unveil!

Motion capture!

https://www…com/watch?v=82zaW1EoYgQ

[=;149270]
Hey all!

I want to thank and Epic devs for their help!

I have an exciting new feature to unveil!

Motion capture!

https://.com/watch?v=82zaW1EoYgQ
[/]

Do you have an updated level with how you are using the kinect now? Been trying to do it the previous ways but stuff has been moved around/deprecated.

Doesn’t have to be polished just looking for working BP

Great Job, and quite impressive.
I wrote plugin for kinect 1, but now I want to move to kinect 2 and I wanted to use your plugin.
May I ask which is the latest plugin ?

[=plangton;152365]
Great Job, and quite impressive.
I wrote plugin for kinect 1, but now I want to move to kinect 2 and I wanted to use your plugin.
May I ask which is the latest plugin ?
[/]

the last stable is 4.4

[=plangton;152365]
Great Job, and quite impressive.
I wrote plugin for kinect 1, but now I want to move to kinect 2 and I wanted to use your plugin.
May I ask which is the latest plugin ?
[/]

Here is a link to lion’s 4.4 branch:

https://github.com/lion03/UE4-K4W-Plugin/tree/KinectV2Plugin-4.4/Engine/Plugins/KinectV2

Hey guys,

Amazing work! I am a complete newbie at this stuff. I do happen to have kinect v2 and would really like to try this out, looks pretty cool. I can’t seem to access the github plugin page, do I need to be a subscriber to UE4 to do this? Sorry to pop in here, but the stuff you guys are doing is pretty fascinating. Keep up the good work.

[=grav3yard00;152569]
Hey guys,

Amazing work! I am a complete newbie at this stuff. I do happen to have kinect v2 and would really like to try this out, looks pretty cool. I can’t seem to access the github plugin page, do I need to be a subscriber to UE4 to do this? Sorry to pop in here, but the stuff you guys are doing is pretty fascinating. Keep up the good work.

[/]

Yes you do have to subscribe to unreal engine to be able to see it/download it.

The nice thing is you can subscribe for 1 month and cancel. You get to keep/use unreal engine you just don’t get any updates. You will always be able to use the version you had when you subscribed, just resubscribe if/when you want updates!

[=;152553]
Here is a link to lion’s 4.4 branch:

https://github.com/lion03/UE4-K4W-Plugin/tree/KinectV2Plugin-4.4/Engine/Plugins/KinectV2
[/]

I have no issues building the latest UE4.4.3 from source; however, I can’t seem to get lion’s latest branch to compile without throwing the following errors/warnings. Probably forgetting something silly, but do you guys have any advice? I also have DK2 and Kinect V2.


Warning	1	warning C4996: 'gethostbyname': Use getaddrinfo() or GetAddrInfoW() instead or define _WINSOCK_DEPRECATED_NO_WARNINGS to disable deprecated API warnings	C:\UE4-K4W-Plugin-KinectV2Plugin-4.4\Engine\Source\Runtime\Sockets\Private\BSDSockets\SocketSubsystemBSD.cpp	62	1	UE4
Error	2	error LNK1181: cannot open input file 'atls.lib'	C:\UE4-K4W-Plugin-KinectV2Plugin-4.4\Engine\Intermediate\ProjectFiles\LINK	UE4
Error	3	error : Failed to produce item: C:\UE4-K4W-Plugin-KinectV2Plugin-4.4\Engine\Plugins\OculusRift\Binaries\Win64\UE4Editor-OculusRift.dll	C:\UE4-K4W-Plugin-KinectV2Plugin-4.4\Engine\Intermediate\ProjectFiles\ERROR	UE4
Error	4	error MSB3073: The command "..\..\Build\BatchFiles\Rebuild.bat UE4Editor Win64 Development" exited with code 2.	C:\Program Files (x86)\MSBuild\Microsoft.Cpp\v4.0\V120\Microsoft.MakeFile.Targets	43	5	UE4


Edit:

If I put Lion’s kinectV2 plugin folder into the original UE4.4.3 source it compiles, but I get the following UE4Editor system error on launch:


"The program can't start because Kinect20.VisualGestureBuilder.dll is missing from your computer. Try reinstalling the program to fix this problem"

I’ve got the latest Kinect SDK installed and the dll is at the following location:


C:\Program Files\Microsoft SDKs\Kinect\v2.0-PublicPreview1409\Redist\VGB\x64\Kinect20.VisualGestureBuilder.dll

Hello,

No idea if I’m asking in the right topic.

I own a Kinect4Windows v1 (not the v2), is there an equivalent of this plugin for the Kinect v1? Or is it only possible to work with a Kinect v2 for UE4?
Also I do not want to create interaction or an animated avatar with the Kinect, I would just like to place the image of the person in front of the kinect inside the game, minus the background (his room…). Would this be possible? (now that I think of, maybe a regular webcam could do it?)