Kinect 4 Unreal

[plangton]

@;747255

I’ve decided I will. It’s been some time that I’ve ben seeing people asking for a Kinect plugin that lets you compile the project. I just have to buy a sensor because I did my plugin using a customer’s sensor for a job, and also change some names in the C++ APIs because it currently uses the customer company name. But the plugin got pretty neat, Unreal keeps steady at more than 60fps even when displaying all the cameras’ textures in the viewport (in a GTX 970 and i7 930). What price would you guys suggest?

The head rotation works in mine but it’s limited. If you look more than about 50º to the sides, it loses tracking but that’s a Kinect thing.
@plangton @sandeep.nsk
Wouldn’t the Matrix Projection stuff be overkill? You can rotate the camera with the head joint rotation detected from the sensor. The problem is latency, though (would happen even with matrix projection). Kinect 2.0 is pretty good, near realtime, but still 30fps so you need to do a bit of interpolation to avoid stuttering in Unreal’s 60+fps and, also, if using it with a HMD the user WILL have motion sickness because of the latency (unavoidable). I’ve done something similar using Trinus with a cellphone for the head rotation tracking and Kinect would give me the head and hands location in the world.

I think you didn’t exactly get my point about the projection matrix.
there are two problem that have to different solution. to make it simple you have to distinguish between a head and eye rotation
firstly check this video out : ://www.youtube.com/watch?time_continue=11&v=90kHhOUzeQc
you’ll see that without an actual change in the camera position you have what is projected to you changed. this is not quite equivalent of rotating the camera cause a game camera is not a complete equivalent of how our perception works. but in most cases you should be able to replicate it by just simply transforming the camera.