[WIP] Lumia, toolbox plugin for MIDI,OSC, DMX and Audio

Development Pipeline & Plugins Plugins
,
1

Hi everyone,

I’m the developer of Lumia, an Unreal Engine plugin/toolkit focused on interactive media installations and real-time projects driven by external data sources such as Audio, MIDI, OSC and DMX.

https://www.youtube.com/watch?v=6zmU9-au0EM

I created a page with video content to explain the idea, show the workflow, and give a first impression of what Lumia is trying to solve. I would really appreciate feedback from Unreal users, artists, technical designers, developers, and anyone working with live visuals, interactive installations, stage systems or audiovisual tools.

The main goal of Lumia is to lower the technical barrier for real-time creative work in Unreal Engine. It is designed to make workflows around live data, routing, remapping, cameras, audio analysis, and runtime configuration more transparent and easier to use.

Some of the things Lumia focuses on:

  • Runtime-ready handling of Audio, MIDI, OSC and DMX data

  • Extended AudioCapture with microphone device selection

  • Real-time spectral analysis

  • Input configuration through plugin settings and `.ini` files

  • FlexGraphs for remapping, rerouting and mixing data

  • Camera fades and transitions

  • Consistent behavior in Editor, PIE and packaged builds

  • Easier access to workflows often used in virtual production and interactive media setups

I’m not posting this as a finished “product announcement,” but because I’d like to know whether the concept makes sense to people outside my own development bubble.

I would be very grateful if you could take a look at the page/videos and give me constructive feedback:

A few questions I’m especially interested in:

  • Is the concept clear from the videos?

  • Does Lumia solve a problem you have experienced in Unreal?

  • Which feature looks most useful or interesting?

  • What would you want to see explained better?

  • Would this be useful for installations, live visuals, stage setups, exhibitions, or audiovisual projects?

  • Is anything confusing, missing, or unnecessary?

Any honest feedback is welcome — technical, creative, critical, or practical.

Thanks!

2

Here I’m showing a workflow for routing audio from Ableton Live into Unreal Engine. For this, I’m using ASIO Link Pro (https://give.academy/ODeusASIOLinkProPatcher/ )

With ASIO Link Pro, it is possible to route the signal from Ableton to a microphone input channel via ASIO. In Lumia, I can select the microphone input channel and route it into a Submix. The Submix signal is then split into frequency bands using FFT, and I can use the individual values for visualizations.

In this video, I created a visualization using Motion Design.

Thanks to ASIO, the latency is extremely low. Depending on the visualization and the speed of the beat, the FFT settings may need some fine-tuning.

At the end of the video, you can also see that Lumia works in a packaged EXE build.

Unlike Unreal Engine’s Audio Capture Component, which only allows you to use the default Windows input microphone, Lumia gives you the option to select a specific microphone input.

This is especially important when working with ASIO Link Pro, because the software creates multiple virtual microphones .

This makes it possible to route multiple channels separately from Ableton, or other DAWs, into Unreal Engine

3

Hi, in this example I show how to use Lumia in Unreal to drive Sequencer animation with audio.

I animate the time of a Chaos Cache Manager to play back a fracture animation. Since we are working with normalized values, I can easily change the loop points of the sequence.

I also show how the FlexGraph can reroute the signal at runtime and fine-tune it using a curve.

This time, the audio signal comes from iTunes and is routed into Unreal as a microphone input via ASIO Link Pro.

4

In this example I show how Lumia makes it easy to connect MIDI devices in Unreal Engine and use them to control a DMX device that also reacts to FFT audio data.
Since the data is processed across different value ranges, we use the FlexGraph to remap and combine the data streams.
Maximum flexibility without coding.

5

Here’s a workflow showing how to route video from Unreal Engine to Resolume via NDI using Lumia.

Unreal Engine already has the tools needed for this, but the setup is mostly designed around virtual production workflows. With Lumia, I’m trying to make the process a bit more straightforward for artists who want to use Unreal for live visuals and VJing without having to deal with too much technical setup.