An Unoffical plugin for Intel’s RealSense 3D camera. This is an early alpha release with limited support, expect an incomplete SDK bind.
Currently supports hand tracking via joints, face tracking via landmarks, and gesture support. Other features are available in C++. Hopefully more of the RSSDK’s features will be exposed to blueprint in the future
Please note that RealSense requires Windows 8.1 and a 4th generation Intel Core Processor to function correctly, see the devkit page for details.
Update: Use the official plugin, it is likely better: See The World In New Ways With The Intel RealSense Plugin For Unreal Engine 4 - Unreal Engine
Download
Latest - 0.2.0 - UE4.9, RSSDK0.6
Resources
Github - Main Plugin Source and Documentation
Intel Plugin Thread - Intel Developer forum thread
Installation
- Make sure you have the newest drivers
- Download Plugin
- Create new or open a project.
- Browse to your project (typically found at Documents/Unreal Project/{Your Project Root})
- Copy *Plugins *folder into your Project root.
- Copy Binaries folder into your Project root.
- Restart the Editor and open your project again.
- Select Window->Plugins. Click on Installed and you should see a category called Input and a plugin called RealSense Plugin now available.
Quick Setup - How To Add a RealSense Component and RealSenseInterface to any Blueprint
-Open the blueprint you wish to receive RealSense events.
-Add the RealSense Component to your blueprint by clicking Add Component
To receive events we now have to add an interface. Click on Class Settings and under Details find ‘Add’ under interfaces. Add the RealSenseInterface.
Blueprint - Example Joint Debug Hands
You can easily modify the graph to output the hands to a more realistic location by changing the added origin from actor origin to a hand offset component attached to the actor.
Blueprint - Example Gestures
To receive gestures you need to enable gestures before using them, e.g. in your begin play.
Then simply subscribe to the event you are interested in. In the above example we output the body side appended to a verbose thumbs up print. This will show every time the gesture is detected.
Do note that there is currently a performance penalty when you enable gesture detection, multi-threading gestures is on the to-do list.
Changelist
0.2.0
-Multi-threading! alpha state though some things may not be safe
-Supports non-locking joints and landmark streaming
-Lots of UE RS classes added, not all available at this time
-Update to UE4.9
0.1.3
-Drag and drop setup should now work without crashes with latest RSSDK (0.6)
0.1.2
-Update to UE4.8 and public release.
