I came here on behalf of some of my fellow live visual artist developer friends, casually called VJs. We often work in many different programming environments with various tools to try to accomplish our visions whether simple generative graphics or projection mapping. In recent years game engines that offered real time rendering have provided an interesting tool for us to work with. In example Unity engine has allowed interactive projection mapping such as these examples:
I would also like to put forward a comment about adding OSC and Syphon support.
I work in the field of live visuals and projection mapping, creating animated content that can be played live. There is an increasing demand for this kind of work with brands and festivals (Vivid festival over here in Sydney being the biggest in the Southern Hemisphere), especially when it comes down to audience participation and interactive experiences. Unity has provided a great base for this so far but it would be amazing to see the Unreal 4 Engine be capable of this too, and go further with with it’s implementation - especially as OSC is such a versatile tool.
To see this implementation would open up doors to some fantastic creative opportunities.
We are interested in features like this too! We have an experimental plugin called ‘LiveEditor’ which uses the portmidi library (which is part of our distribution) to allow you to tweak parameters using a MIDI controller. We have not had a chance to polish this up to the level of a supported feature, and we would also like to support OSC instead of MIDI. But if you are feeling brave you could have a go at playing with it!
Hey James, that sounds ace! I’ve still barely even scratched the surface yet with UE4 but I’d love to have a go at using the LiveEditor plugin. Is it documented at all so far or still in it’s raw form?
Native osc would be a game changer : D Im on the same side right now … using unity with uniosc and syphon. I am and many others would jump stright to ue when there will be a solution for this. : ) Dream would be to have an option to assign an osc data value to any slider/component/ with a right click : P Oh and a syphon node in the shader editor : D
JamesG: Are there any possibilities for you guys to do a small tutor or what ever to show how to hook up a component or float to LiveEditor.
Im using vdmx on a mac and it’s able to send midi and osc. So basicly i could convert the osc data from ei kinect / leap etc in vdmx and send out midi to ue.
These are the assets i use in unity would love to see something like this in ue.
Open OSC - yes please! - I’d consider paying a developer to implement this as a blueprint node. The great thing about open OSC is that you can pretty much use it for anything. If there is anyone interested in taking on a project like this please reply here - maybe we could get some funding to you.
To be able to right click on any slider in the interface and to bring up an option assign OSC control would be amazing, as with the ability send a syphon output from a camera in Unreal Engine to projection mapping software (such as madmapper) would have a lot more live visual artists wanting to use Unreal Engine.
I really hope this is implemented at some point.
Olly from 1000 Errors
+1 recent convert from Quartz Composer (QC), was attracted due to the similarities in the visual scripting/coding with Blueprint. I would hope to do some interactive audio visual games and of course MIDI, OSC are key.
Syphon is just a game changer especially as I work with a lot of Augmented reality. Please include these functions into a release of Unreal .