Hi,
I am currently creating a little world in Unreal Engine 5.4.4. The purpose is, to finish this world and in the end, record a 360°-movie including sound within this world. For my question, I simplified my project (in a small test-project) to the following components:
- A dog mesh
- A sound cue for my dog to let it bark
- A panoramic camera (I tried with Panoramic Capture but ended up with some 360 camera I bought on artstation)
I placed that dog, it got sound and I activated Spatialization. In Viewport, the barking direction and volume depends on where I (as the camera) am standing and in which direction I look. Everything is fine. When the dog is “on my left” the barking is louder on the left ear and so on. As far as I have learned from other forum posts the sound is calles something like “ambisonic” (?).
Since I dont want to use the Viewport or any generated app but a video created from within UE5, I want to record that scene and include sound. It seemed simple:
- 360 camera is on a fixed Position
- Record video and sound
- Watch that video with some VR Glasses (Meta Quest 2)
Recording the video is ok with that plugin I got. But the recorded audio seems to be broken. When I watch that scene in VR (after creating a video with ffmpeg), the sound is independent from the direction I am looking. So lets say, the dog is sitting left from the camera and the origin recording camera and its barking. The sound is on my left then, that is okay. But when watching that recorded VR Video I can, lets say, turn my head to the left and look at that dog directly. So I would expect the sound to be centered now, but it stays on my left.
So this question must be the most stupid I have ever written (I hope so), but: how do I record that sound in a way, so that it plays dependend on how I actually watch the video? Otherwise a 360 video makes no sense, because the sound forces one to keep the initial looking direction.
If there is a plugin achieving that correctly recorded sound or anything in my settings, I would appreciate if you let me know. Many thanks in advance!
Best regards
Sky7677