Custom Gesture Recognition

[Deams]

@indygoof;606701

Ok, apologies! I was just a bit…sad, that i had to remove all the mechanics with gestures from my game demo. I should have thought a bit more over it before writing something, or even look at the license file before i started anything with it.

No worries, I was also a bit hard. Hadn’t slept well in a long time and was on a 12 hours flight with a quite irritating neighbor behind me.
So as I said earlier, gonna be tough for me to rewrite everything at the moment, but I’m willing to supervise/help out anyone who feel like taking the challenge as long as it gets released under MIT for to enjoy.

[anonymous_user_92200967]

Deams this is super cool. I was wanting to build something just like this. Looking at the code and reading the paper, I’m glad you did it (it’s all a bit beyond me). Props!

[atlasan]

Hi there!

I started playing with your gesture plugin and I’m trying to save the gesture data to a file so they will be ready on game start.
I’ve set the VRGestureRecognition component variaible TemplateFilePath to a full local path (C: est emplate.txt) and a relative one (. est emplate.txt or template.txt) but I can’t see any file.

Thanks in advance and thanks for sharing cool code!

[Deams]

@lukefwilson;625129

Deams this is super cool. I was wanting to build something just like this. Looking at the code and reading the paper, I’m glad you did it (it’s all a bit beyond me). Props!

Thanks Lukefwilson!
It’s a pretty good start, but I still believe there’s ways to improve it to get it game ready.

@atlasan;660066

Hi there!

I started playing with your gesture plugin and I’m trying to save the gesture data to a file so they will be ready on game start.
I’ve set the VRGestureRecognition component variaible TemplateFilePath to a full local path (C: est emplate.txt) and a relative one (. est emplate.txt or template.txt) but I can’t see any file.

Thanks in advance and thanks for sharing cool code!

Hi Atlasan,

The current version does not support saving gestures at the moment, that’s why you don’t get a file.
I was hoping to get the time to start working on a more optimized implementation but got sidetracked by work…

If you want to add support it, I encourage you to fork the repo and write a serialization of the class VRGestureTemplate.
Once you loaded a new gesture, simply re-evaluate the min/values for the space coordinate as done in UVRGestureRecognizer::StopRecordingGesture().

[anonymous_user_73c110f4]

Very good work! :).
I need some informations about the implementation: what machine learning technique did you use to classify?? Did you use another type of solution?
Could you give me more specific information about the plugin structure? I have to insert these informations in my master thesis…I would be grateful

[Deams]

@PJ22;665430

Very good work! :).
I need some informations about the implementation: what machine learning technique did you use to classify?? Did you use another type of solution?
Could you give me more specific information about the plugin structure? I have to insert these information in my master thesis…I would be grateful

Hi PJ22,
I would advise you to check the “Credits” section of the top post, but in short, the plugin is using a particle filter approach with a custom metric.

@Deams;516996

Credits
This plugin would not have been possible without the previous work published by the HCI researchers over the years, and especially the following article by B. Caramiaux et al:
B. Caramiaux, N. Montecchio, A. Tanaka, F. Bevilacqua. Adaptive Gesture Recognition with Variation Estimation for Interactive Systems. ACM Transactions on Interactive Intelligent Systems (TiiS), 4(4), 18-51. December 2014

[qzl90082831]

can i save the gesture so that i can use it when i restart the game?

[jadorks]

Finally, I can create my own gestures to use in games. Just curious, can this plugin be used outside VR or it’s VR only? For example, creating custom gestures to use in mobile games, like that of Magic Touch: Wizard For Hire ( https://play.google.com/store/apps/details?id=com.nitrome.magictouch&hl=en ) or ( https://itunes.apple.com/us/app/magic-touch-wizard-for-hire/id946917251?mt=8 )