When playing an audio stream from audio2face using pixel streaming, there is sound distortion.

Development Pipeline & Plugins
,
1

I am trying to use Audio 2 Face and PixelStreaming in my project, but the following problem has arisen: When using pixel streaming to play an audio stream from audio2face, the sound from audio2face is played, but the sound quality is poor and there is a problem with the sound being distorted.
What’s the best way to get a clean sound?

2

Hi there DTCXR!

I’d be happy to offer some advice if I can. Could you please let me know which version of Unreal Engine and which version of the Pixel Streaming Infrastructure you are using?

I can’t offer any advice on Audio2Face, but maybe there are improvements to be made on the UE / Stream side.

3

Hello, may I ask what is the reason why I can’t play the audio when I use the pixel stream to play the audio stream from audio2face.

4

Hi, that’s a known issue. You could take a look at the following plugin, it performs high quality lip sync in realtime from any audio data source with minimal latency, even on mid-range CPUs, and supports packaged projects, as well as in the Pixel Streaming environment: Runtime MetaHuman Lip Sync (AI for NPCs) (+ CC4, Genesis, ARKit, and more) | Fab