Hi there, thank you for your enquiry.
Microphone feature in Pixel Streaming at this stage isn’t intended to work as a voice chat. Its main purpose is to send the audio data back to UE (which is why you’ll be able to hear yourself when you enable the mic), which then allows for it to be handled further. Once the data is in UE, it is then possible to pass the audio stream to a voice chat plugin, which will involve a bit of custom code work, depending on your plugin.
There are a few ways to then get the audio data out of the voice plugin and feed it back into PixelStreaming to be able to hear the other players:
- Choose a voice chat plugin whose audio data goes through the Unreal audio system, which will allow Pixel Streaming to just pick up the audio as per normal
- Complete the implementation of Pixel Streaming audio mixer and plug the audio from your voice plugin into that - see this class for a jumping in point: https://github.com/EpicGames/UnrealEngine/blob/release/Engine/Plugins/Media/PixelStreaming/Source/PixelStreaming/Private/AudioInputMixer.h
Alternatively, you can modify Pixel Streaming C++ code to redirect the audio data and instead of passing it to the Unreal Engine’s audio system, pass it to your voice chat plugin. For this, you’ll need to have a look at creating your own audio sink (which is what the Pixel Streaming audio component does):
I hope this helps!