Speech Recognition Plugin - Sphinx-UE4

It’s not currently set up to work on Android (there are some defines/checks in the code that look for WIN32/64), but there is a libOVRLipSync.so file available in the Unity package, so it would mainly be an issue of fixing the defines and setting up the Build.cs to find the correct file (the .so) when on Android.

The other thing is that I’m not sure if the VoiceCapture interface operates the same way on Android, so that might be a sticking point.

As far as tutorials for setting it up, there aren’t any currently - I’m going to try and upload an example project here soon that uses the Unity example head mesh.

That said it’s quite simple really - the event returns an FOVRLipSyncFrame, which holds an array of 0-1 float values corresponding to viseme morphs - e.g., SIL, FF, PP, oh etc - mouth shapes. You then just feed these values into the appropriate morphs in your custom event (e.g., foreach loop, set morph value on your mesh).

I will try and get an example project up shortly.

No worries! I was planning to contact them to try and get this into an official release at some point anyhow. :slight_smile: