the first video shows a chinese artist using zigsim app, sending the phone’s rotation (gyroscope/accelerometer) via OSC to blender and controlling the light. that inspired me to do something simialr in Unreal Engine. However I’m sending my phone’s light sensor data to Unreal Engine via OSC, and using blueprint to match the lighting in the Unreal to the lighting of my room (which is picked up by my phone’s light sensor).
I love using Unreal Engine as an Interactive Art and installation tool and regularly do these little tricks with it. even if it’s not conventional to do so.
not many people realize how good Unreal can be as a tool for making interactive experiences. Althouth it’s not wired to do these type of stuff, it’s surely capable to do it all, and It’s actually much more fun to do these stuff inside a game engine, where you have access to so many other things, rather than dedicated Interactive Art software !!!
1 Like
This is very impressive, the way that you found to do this with OSC.
May I ask how you came across OSC to use it for controlling the light via phone?
I’ve been producing electronic music for many years, and I always had a thing for controllerism, doing live show visuals and other control tricks with different devices. in the world of Live Performance & Live Music Visuals, OSC (Open Sound Control) is really popular, so I learned it those years and found out just how easy & amazing it is to control not just VJ, DJ, and music software, but all sorts of other software as well.
coming to Unreal Engine, as a real-time 3D development engine, I saw a huge potential in using OSC, to communicate with outside devices and sensors (phone sensors, Arduino), and use them as interactive controllers for the virtual worlds in Unreal.
and Unreal being a game engine, the possibilities are endless and I know there are many more cool tricks to do, waiting around the corner.
1 Like
