I am trying to connect to Text-To-Speech powered by Google AI (LINK), it needs a simple request using HTTP and the request body holds all the input parameters such as text etc.
from what i have heard that it throws back raw binary data, I want this to be able to be used inside unreal engine is there any utility that can convert the binary data into a Sound file that I can play using Play Sound 2D or Play sound at location?
You should not make it an asset file on disk, that’s wrong for two reasons:
It uses storage even when not necessary, which slows down things and eats up disk space and can fail.
Unreal packaged games are different from unreal editor source files; you’d have the “bake” the sound to create a proper asset file, and “baking” is code that’s part of the editor, not part of the runtime.
hmm, a bit offtopic but that means it’s not possible to make a product where let’s say player can bring in their own 3d models in .fbx and game starts using those at runtime while the game is running? cus they won’t be .uassets.
You can bring in geometry at runtime – there are procedural mesh objects, for example – but they won’t be “assets” as Unreal manages and knows them.
And all the optimization Unreal does, would have to be up to you – no automatic triangle reduction, tangent basis calculation, and so on. And shader re-compilation would be quite a challenge.