I implemented a proof of concept for integrating both Coherent UI and Leap Motion to create a virtual “touch screen” type interface in-game.
You can see it in action here:
You can also check out the source code on github:
Would welcome any feedback!
Also, as part of this development I developed a raytrace-based input (need the raytrace to select the Coherent UI view that has input focus anyway). Here is the raytrace-based input showing using the HMD as a mouse pointer directly (just use regular mouse or controller buttons for click actions):
Here is an example of interacting with an object that is tens of meters away in virtual space and would be out of reach of hand-based input: