Hey there!
I’m looking to create a game similar to Audiosurf in that audio files given by the user are analyzed and content is displayed on the screen depending on tempo, when a drum is hit, etc. As far as I can tell, there isn’t really any way to go about doing this in UE4 - the Audio library seems to be designed for playback rather than analysis. Is there anything I’m not seeing that would help out with this project?
Thanks!
As far as I know there isn’t much audio functionality aside from playing it back. You should look into implementing the Fast Fourier Transformation, which is an algorithm and will basically be the bread and butter of what you want to do.
As long as you can get the sample data from the audio files you should be able to implement your own analysis code. I’d recommend checking out http://musicdsp.org/ for a whole bunch of dsp algorithms. You could also check out some third party libraries such as JUCE or FMOD.
I remember hearing that EPIC have hired some audio coders too, it’ll be interesting to see what they come up with.