Hello, I want to ask about the pixel streaming, is there a way to make the microphones work? Because among every resource I see are mostly using the console and not pixel streaming.
Hi there, thank you for your enquiry.
Microphone feature in Pixel Streaming at this stage isn’t intended to work as a voice chat. Its main purpose is to send the audio data back to UE (which is why you’ll be able to hear yourself when you enable the mic), which then allows for it to be handled further. Once the data is in UE, it is then possible to pass the audio stream to a voice chat plugin, which will involve a bit of custom code work, depending on your plugin.
There are a few ways to then get the audio data out of the voice plugin and feed it back into PixelStreaming to be able to hear the other players:
- Choose a voice chat plugin whose audio data goes through the Unreal audio system, which will allow Pixel Streaming to just pick up the audio as per normal
- Complete the implementation of Pixel Streaming audio mixer and plug the audio from your voice plugin into that - see this class for a jumping in point: https://github.com/EpicGames/UnrealEngine/blob/release/Engine/Plugins/Media/PixelStreaming/Source/PixelStreaming/Private/AudioInputMixer.h
Alternatively, you can modify Pixel Streaming C++ code to redirect the audio data and instead of passing it to the Unreal Engine’s audio system, pass it to your voice chat plugin. For this, you’ll need to have a look at creating your own audio sink (which is what the Pixel Streaming audio component does):
I hope this helps!
Does this work if I copy and replace it? Like I replace the plugin code or replace its existing folder in the UE editor.
Hello Sir Denis?
It didn’t work
I have tried many times, but all I could get is hearing the voice of myself, with weird noise and big delay.
So meaning that solution doesn’t help with voice chat?
you are trying find a solution voice(video) chat for Pixel Streaming by send data back to UE server but i think it is terrible solution
there are simple way is intergrate a voice(video) chat to front-end web like zoom ( Web Video SDK)
What’s those on integrating the voice chat pixel streaming to UE server?
@dagon1999
pixel streaming to UE server is one way streaming
video in ue-game server (stream data) → turn server → many client pc
client pc control (very small data )-> signalling server → ue-game server
it does not have way to send streaming data from client to ue-game server so if you need integrating the voice chat pixel streaming to UE server you must implement many problem
simplest is using 3rd party streamming or create a server for voice chat (modify signalling server cirrus.js)
“GitHub - amirsanni/Video-Call-App-NodeJS: A conference call implementation using WebRTC, Socket.io and Node.js”
client pc voice chat ↔ webrtc voice chat server
and it does not need voice data pass ue-game server
So this might work without doing any c++ code or UE plugins right?
@dagon1999
Exactly
Noted, I will try this method out. Thanks
Any suggestions for a voice chat (no video) plugin that would work for both pixel streaming and desktop (windows) client?
There is one and its EOS voice chat haven’t tried but some devs use it.
Please let me know if it does work for Pixel Streaming.
@cjlee
Perhaps you could help suggest a similar issue to audio. This issue arises for facial capture using LiveLink – in a multi player game that’s being pixel streamed, there is one avatar for whom I’d like to send real time audio + (face) mapping data using a LiveLink setup to respond to other avatars who are sending text messages. Can you suggest a way to do this?
I’m using vivox as voicechat sdk. Simply opening the mic in game doesn’t open it in browser through pixel-stream so i have no input on microphone in browser. Weird behaviour and noone knwos how to fix or suggests a workaround. Tough times we are living in.
Hello @Kage-Shi09,
If you are still looking for a solution to stream your application with audio and microphone support, you can do it with Vagon Streams. - Vagon | Streams - No code, interactive cloud streaming
The good part is, you won’t need to deal with the integration process. Just enable microphone support inside your build, be sure that it’s working locally, and then upload your app to Vagon Streams, that’s all.
You won’t need any custom integration to start, and you will be able to stream your application with no latency, and no echo audio experience anywhere with more than 20+ regions worldwide.
In case you would like to test it, you can create an account yourself, or contact me for further details.
Have a nice day. 
Hey, support for capturing audio from microphone within Pixel Streaming is now available in the RuntimeAudioImporter plugin. Please refer to this documentation page for more details.