I hope so too. So stupid. Literally can just make it available directly from the media player.
In UE5, in order for the sound to play on a media player video you need to have a “Media Sound” component added to some actor that is present. I use the player controller for this a lot. Just add the media sound component and then select your media player in the details panel. You should hear sound after that.