We are relying heavily on the use of the media stream. It works really well to stream mp4 files from webservers into the engine - buffers great and maintains good fps. Altough on slower pcs it really eats away performance.
So here is the question:
A. How can you debug the media stream are there specific stats for it?
B. What can we do to optimize the Workload for a streamed media so that slower pc do not suffer stutters and lags
Should we switch to another file format? Mp4 - H264 - no Audio
Insights:
I tested many files ranging from MP4 (H265, H264) - WMV - MPG - VP9/VP8 & Many more.
I can safely say stick with h264 as it is the best in overall performance.
The FPS did not inherit a significant performance issue (24-30fps seems to be the same)
The rResolution of the file is now served depending on the Pixeldensity ( helps alot! )
Bandwith did the biggest impact. A variable bitrate helped maintaining a somewhat good quality.
Important is to encode it for streaming first with the “moov” atom at the beginning.
Will not put this as an answer because i think we still need tools and stats to debug the media engine.
H264 files in a .mov container is also very performant + the only way for seamless loops!