# Help on writing android voice module? **URL:** \ **Category:** Audio\ **Tags:** unreal-engine, voice, Android, UE4, question\ **Created:** [April 1, 2015, 3:07pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412 "2015-04-01T15:07:01Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 1, 2015, 3:07pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/1 "2015-04-01T15:07:01Z")
I’m currently successfully using the Voice Chat feature available through OnlineSubsystemNULL on PC and I’d like to extend the same functionality to my Android clients. Though OnlineSubsystemNULL seems to work also on Android, the voice subsystem is currently not implemented on this platform (so I cannot neither send or receive voice chat when connected in a multiplayer session). I’d like to help writing the missing code, but since I’m quite new to the UE source code, I would need some guidance. In particular: - Is the opus encoder / decoder available on android? Trying to use it (e.g. enabling Android in VoicePrivatePCH.h) causes linker errors, what shall I modify to link this lib also to Android? - If I wanted to write a VoiceModule for Android what libs may I use? OpenAL? other? Thanks, any help would be appreciated! ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 14, 2015, 8:55am UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/2 "2015-04-14T08:55:05Z")
Any feedback? In particular, how can compile and link lib opus in the source code? ---
**Author:** ![Chris\_Babcock](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@Chris\_Babcock](https://forums.unrealengine.com/u/Chris_Babcock)\ **Post date:** [April 23, 2015, 3:53pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/3 "2015-04-23T15:53:35Z")
libopus is currently supported on Windows, Mac, and Linux in UE4. I haven’t tried making it for Android, but these steps may work. There is an android.mk for libopus here: [https://android.googlesource.com/platform/external/libopus/+/master](https://android.googlesource.com/platform/external/libopus/+/master) Compile a libopus.a and libspeex\_resampler.a for ARM and optionally x86. Create an opus-1.1/Android/ARMv7 directory and optional opus-1.1/Android/x86 directory and copy the .a files into them. Making the following addition to libOpus.build.cs in Engine/Source/ThirdParty/libOpus: ``` else if (Target.Platform == UnrealTargetPlatform.Android) { PublicAdditionalLibraries.Add(LibraryPath + "/Android/ARMv7/libopus.a"); PublicAdditionalLibraries.Add(LibraryPath + "/Android/ARMv7/libspeex_resampler.a"); PublicAdditionalLibraries.Add(LibraryPath + "/Android/x86/libopus.a"); PublicAdditionalLibraries.Add(LibraryPath + "/Android/x86/libspeex_resampler.a"); } ``` ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 24, 2015, 1:02pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/4 "2015-04-24T13:02:48Z")
Thank you, that was exactly was I looking for! Everything worked like a charm and I’ve copied the static libs in the folder you said, but when I try to build UE4Game for Android I get the following error, is there any further configuration I should do? ``` MBP:UnrealEngine-Fork xxx$ ls Engine/Source/ThirdParty/libOpus/opus-1.1/Android/ARMv7/libspeex_resampler.a Engine/Source/ThirdParty/libOpus/opus-1.1/Android/ARMv7/libspeex_resampler.a MBP:UnrealEngine-Fork xxx$ ls Engine/Source/ThirdParty/libOpus/opus-1.1/Android/ARMv7/libopus.a Engine/Source/ThirdParty/libOpus/opus-1.1/Android/ARMv7/libopus.a MBP:UnrealEngine-Fork xxx$ ./Engine/Build/BatchFiles/Mac/Build.sh UE4Game Android Development Setting up Mono Engine/Build/BatchFiles/Mac/SetupMono.sh: line 32: [: /Users/xxx/Documents/Unreal: binary operator expected Building UBT... 0 Error(s) Building UE4Game... 2015-04-24 14:54:56.271 defaults[41608:4942887] The domain/default pair of (/Users/xxx/Library/Preferences/com.apple.dt.Xcode, IDEBuildOperationMaxNumberOfConcurrentCompileTasks) does not exist Running command : Engine/Binaries/DotNET/UnrealBuildTool.exe UE4Game Android Development -deploy Compiling Native code with NDK API 'android-19' Performing 1 actions (8 in parallel) [1/1] clang++ UE4Game-armv7-es2.so clang: error: no such file or directory: 'ThirdParty/libOpus/opus-1.1/Android/ARMv7/libopus.a' clang: error: no such file or directory: 'ThirdParty/libOpus/opus-1.1/Android/ARMv7/libspeex_resampler.a' -------- End Detailed Actions Stats ----------------------------------------------------------- Cumulative action seconds (8 processors): 0.00 building projects, 0.00 compiling, 0.00 creating app bundles, 0.00 generating debug info, 0.11 linking, 0.00 other UBT execution time: 5.43 seconds ``` ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [May 2, 2015, 10:56pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/5 "2015-05-02T22:56:58Z")
Ok, done with compiling lib opus (even though with the problems above, I had to use absolute paths in libOpus.build.cs to link with of course is just ok for working on but not for a pull request), done with a basic VoiceModuleAndroid.cpp that initialises the encoder and decoder. Now I need to work on the capture part. How do I integrate this with the existing engine audio infrastructure? I’ve seen that for playback the initialisation of the engine happens in AndroidAudioDevice.cpp. I suppose the HW initialisation should be up to the engine, and done just once. How do I properly get a reference to this instance of the engine? ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [May 7, 2015, 8:13am UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/6 "2015-05-07T08:13:59Z")
Ok, capture part mostly done and working! Pending issues: - Building lib opus: I had to rename the opus-1.1 folder to “jni” in order to have ndk-build working, plus I had to move the static libs manually. I would need some help on fixing and automatising this in the UE4 source code - As noted in the comment above, I had to use absolute paths in libOpus.build.cs in order to being able to link the libs. - On Android, I had to implement the OnSoundWaveStreamingUnderflow callback in order to have audio playback working (underflow would cause audio to stop). Currently I’m filling up the missing data with zeros and it kind of works, but probably there are better solutions (e.g. have the callback wait for enough data before proceeding). This issue also affects audio streaming on OS X (here it doesn’t stop the streaming, but causes weird stutters). Discussed this with Josh Markiewicz, I can provide more info here if needed. - There is a crash in SoundWaveStreaming.cpp due to concurrent access to an array. More info about this [here I’m available for any further info, please let me know if more details are needed. [Android - Crash in SoundWaveStreaming - Audio - Epic Developer Community Forums](https://answers.unrealengine.com/questions/224085/android-crash-in-soundwavestreaming.html) ---
**Author:** ![anonymous\_user\_92200967](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_92200967](https://forums.unrealengine.com/u/anonymous_user_92200967)\ **Post date:** [May 10, 2015, 8:32pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/7 "2015-05-10T20:32:49Z")
Hi devel.mad. I’m trying to get this to work on my android as well. I just need simple mic detection for noises, no play back or anything else. Have you gotten this working/can you help me out? What did you do to get to the point where you could read mic input from android? ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [May 10, 2015, 10:09pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/8 "2015-05-10T22:09:36Z")
Still working on it 🙂 What you are trying to achieve shouldn’t be too hard, you have to use OpenSL in Android for capturing are playing back audio. Here is an article with a working example on how to use it: [https://audioprograming.wordpress.com/2012/03/03/android-audio-streaming-with-opensl-es-and-the-ndk/](https://audioprograming.wordpress.com/2012/03/03/android-audio-streaming-with-opensl-es-and-the-ndk/) ---
**Author:** ![Senken](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@Senken](https://forums.unrealengine.com/u/Senken)\ **Post date:** [August 15, 2015, 5:37am UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/9 "2015-08-15T05:37:53Z")
Hey devel.bmad, i am sorry i am no help to your problem however i am trying to implement voice chat on PC alone, but am finding it difficult to find info on for unreal engine 4. I thought that maybe you might have had it working for PC initially and then worked on getting it sorted for android, and if so, maybe you could give me some information on how you got voice chat on pc working (even just links to any help if you used any) , it would be much appreciated. Thanks a lot. ---
**Author:** ![FrankKappaPride](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@FrankKappaPride](https://forums.unrealengine.com/u/FrankKappaPride)\ **Post date:** [April 14, 2016, 3:26pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/10 "2016-04-14T15:26:45Z")
Hi devel, I am trying to implement the voice capture part right now as well and have no direction of where I should go. Do you mind giving me a bit help on that? Also would be great to have the Opus library since I was unable to compile it. Thanks ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 14, 2016, 10:53pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/11 "2016-04-14T22:53:05Z")
Hi FrankKappaPride, as concern the Opus library I used the following steps: - Started from the opus-1.1 folder in UnrealEngine/Engine/Source/ThirdParty/libOpus - modified the android.mk linked by Chris Babcock above to compile speex\_resample.a - renamed temporary the folder opus-1.1 in “jni” as a workaround for an ndk compilation problem - ndk-build opus - ndk-build speex\_resampler - copied the static libs libopus.a and libspeex\_resampler.a in Engine/Source/ThirdParty/libOpus/opus-1.1/Android/ARMv7/ - modified libOpus.build.cs adding: This was never checked into GIT because I needed some guidance about how to properly build the lib with the UE4 source code (I build manually the libs and copied them in the appropriate folders). You can find the files I used here: > **[Google Drive: Sign-in](https://accounts.google.com/v3/signin/identifier?dsh=S218636440%3A1685903136490104&continue=https%3A%2F%2Fdrive.google.com%2Fopen%3Fid%3D0B7SpUfi4PH7aWVhoYlY4TThobFU&ffgf=1&followup=https%3A%2F%2Fdrive.google.com%2Fopen%3Fid%3D0B7SpUfi4PH7aWVhoYlY4TThobFU&ifkv=Af_xneEeiclc-CXXtmnrPzlU-n6vrX-i4Zv9IbNiZR50t7cQT54EDKZqld_8hD06CnW-58L9yizLiQ&osid=1&passive=1209600&service=wise&flowName=GlifWebSignIn&flowEntry=ServiceLogin)** > > Access Google Drive with a Google account (for personal use) or Google Workspace account (for business use). As concerns the capture part, my implementation of the VoiceModuleAndroid.cpp is here: [https://drive.google.com/open?id=0B7SpUfi4PH7aS1VMcHQ4cmpWbnM](https://drive.google.com/open?id=0B7SpUfi4PH7aS1VMcHQ4cmpWbnM) It’s perfectly working, but the code is not very clean. The code was partially derived by these tutorials: [https://audioprograming.wordpress.com/2012/03/03/android-audio-streaming-with-opensl-es-and-the-ndk/](https://audioprograming.wordpress.com/2012/03/03/android-audio-streaming-with-opensl-es-and-the-ndk/) [https://audioprograming.wordpress.com/2012/10/29/lock-free-audio-io-with-opensl-es-on-android/](https://audioprograming.wordpress.com/2012/10/29/lock-free-audio-io-with-opensl-es-on-android/) It would be great if you or some of the audio engineers from Epic (@MinusKelvin? are you listening?🙂 ) could clean this up and integrate it in one of the future official releases of UE4. Let me know if you need more details. ---
**Author:** ![FrankKappaPride](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@FrankKappaPride](https://forums.unrealengine.com/u/FrankKappaPride)\ **Post date:** [April 15, 2016, 4:53pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/12 "2016-04-15T16:53:57Z")
Hi devel, thanks for the reply! Opus worked out really well 🙂 . Two things, the one you posted is VoiceModuleMac.cpp, are they using the same one or just a mistake? Also, do you play the soundwaveprocedural to play the raw PCM data? It is causing me an error and I’m not sure if you had the error before. I mentioned it in this thread :[USoundWaveProcedural crash on android - Audio - Unreal Engine Forums](https://answers.unrealengine.com/questions/405344/edit.html). ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 16, 2016, 3:23am UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/13 "2016-04-16T03:23:20Z")
Sorry, my bad. This is the right file: [https://drive.google.com/open?id=0B7SpUfi4PH7aZEVXaGxKeXdGanc](https://drive.google.com/open?id=0B7SpUfi4PH7aZEVXaGxKeXdGanc) This was tested in 4.9, some modifications may be needed for 4.11, let me know how it goes. I didn’t have to use soundwaveprocedural to play the data, this was handled directly by VoiceEngineImpl.cpp (haven’t checked if this changed in in 4.11 though) Also, if you found a way to properly integrate the generation of the opus libraries please share 🙂 ---
**Author:** ![FrankKappaPride](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@FrankKappaPride](https://forums.unrealengine.com/u/FrankKappaPride)\ **Post date:** [April 16, 2016, 9:24pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/14 "2016-04-16T21:24:45Z")
Hi devel, thanks for the help! You literally saved my day 🙂 I will test the capture part out on Monday! I believed that the opus library is just a normal static library compiled with ndk tool chain. I found the command here: [GitHub - xuan9/Opus-Android: Build Opus lib with Android ndk-build](https://github.com/xuan9/Opus-Android). After that I moved the .a file to the right place and modified the build.cs accordingly and everything seems to be working. I should probably do a pull request with the Android version soon enough. ---
**Author:** ![FrankKappaPride](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@FrankKappaPride](https://forums.unrealengine.com/u/FrankKappaPride)\ **Post date:** [April 18, 2016, 9:39pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/15 "2016-04-18T21:39:57Z")
Hi, I tested the Android voice module and seems like it’s working. I just have a question: ``` uint32 MaxRawCaptureDataSize = 100 * 1024; TArray RawCapture; RawCapture.AddUninitialized(MaxRawCaptureDataSize); uint32 NewVoiceDataBytes = 0; EVoiceCaptureState::Type MicState = VoiceCapture->GetCaptureState(NewVoiceDataBytes); if (MicState == EVoiceCaptureState::Ok && NewVoiceDataBytes > 0) { VoiceCapture->GetVoiceData(RawCapture.GetData(), NewVoiceDataBytes, NewVoiceDataBytes); UE_LOG(LogTemp, Warning, TEXT("Getting data with %d bytes"), NewVoiceDataBytes); sendSound(RawCapture.GetData(), NewVoiceDataBytes); } ``` Is this the correct way of using the capture? I did create a voice capture class and called the start function. Also, I see that the readin valie are set to 2048 bytes every single frame. Is it intended? Thanks ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 19, 2016, 10:04am UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/16 "2016-04-19T10:04:20Z")
Hi, cannot remember exactly why I was using those parameters. I had been struggling a bit with underflows and audio artefacts and those values were a good compromise, but I’m not sure this is the best way to have it working. Using smaller values by the way would probably reduce the latency quite a bit. ---
**Author:** ![FrankKappaPride](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@FrankKappaPride](https://forums.unrealengine.com/u/FrankKappaPride)\ **Post date:** [April 19, 2016, 10:18pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/17 "2016-04-19T22:18:56Z")
Sorry to bother again, I am having troubles getting audio playing. I looked the voiceengineimpl.cpp and in fact it is using the soundwaveprocedural. When I use it it gives me an error very deep in AndoirdAudioSource.cpp. Do you have any idea how the OpenSL-\>Enqueue thing works in there? I think It may be the same issue of what you discussed above about filling with zero and a callback. May you explore a little more on that? Thanks Edit: nevermind I got it working now 🙂 ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 26, 2016, 8:33pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/18 "2016-04-26T20:33:54Z")
Hi Senken, you can find some detailed instructions in this thread: [How can I make in game voice communication? - Audio - Epic Developer Community Forums](https://answers.unrealengine.com/questions/49442/trying-to-make-in-game-voice-communication.html?sort=oldest) Let me know if this woks for you. ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [April 26, 2016, 8:35pm UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/19 "2016-04-26T20:35:33Z")
Hi FrankKappaPride, sorry for not replying you before. Which was the issue? I had an issue in AndoirdAudioSource.cpp related to buffer underflows, but that was fixed in 4.9 if I remember well. ---
**Author:** ![anonymous\_user\_389e656c](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@anonymous\_user\_389e656c](https://forums.unrealengine.com/u/anonymous_user_389e656c)\ **Post date:** [October 25, 2016, 8:09am UTC](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412/20 "2016-10-25T08:09:47Z")
Hi FrankKappaPride, all, haven’t checked the git repos for a while, but I have seen the android codec is not yet integrated in the main distribution. If somebody could help me with polishing my implementation (the opus lib compilation in particular) I’d be glad to open a pull request. Is there anybody else who has already opened a request? [Next page](https://forums.unrealengine.com/t/help-on-writing-android-voice-module/313412.md?page=2)