I have set up a pixel streaming solution for my project successfully with matchmaking, TURN/STUN servers etc. and it works pretty well on desktop devices. However on mobile I’ve run into two issues:
On screen UI doesn’t register touch events. I can touch and drag to turn the camera and tap on floors to move so some touch events go through but when I try to tap on any UI elements nothing happens. Curiously I also have some world space UI objects with widget components and they work just fine. With a mouse on desktop the UI works just fine.
The WebRTC stream freezes after 1-2 minutes. I get no error messages, lag, artifacts or anything, the video stream simply suddenly stops moving and only starts again when I refresh the page.
Both these problems happen on every mobile device and browser I’ve tested so far but never on desktop. I have no clue what is causing this. Any ideas?
Well the stream freezing fixed itself once I deleted the packaging folder and did a full rebuild. Would have been nice to know what was causing it though as now there’s no guarantees the same bug won’t come back.
Still can’t get button widgets to respond to touches though.
When using pixel streaming, it’s generally recommended to add buttons on the frontend rather than within Unreal Engine. However, if you prefer to add buttons directly in Unreal Engine, be sure to explore various events like input touch, hover, and release to optimize the user experience.
You might also want to try streaming your application through https://www.streampixel.io/. It could offer better performance for your needs.