Multi-User Server, Ndisplay, and Remote Control Web Interface

Hi All,
I am a developer , developing a template for virtual production using Ndisplay, switchboard and remote control web interface. Over the course of my development I have encountered countless problems which will be detailed below. I am wondering if across the community I am able to get any help/support with some of the issues I am still facing. Due to the lack of documentation in Ndisplay, and overall throughout the engine, the frustration, and negativity have began to grow.

  1. Lack of documentation
    Of course we all understand that Unreal is constantly changing. but the lack of information of countless topics is absolutely astonishing. Most of my time is spend navigating the internet scouring hopelessly for an answer for my random problem. This must be addressed and fixed, and it is funny how it isn’t being addressed in real time.

2.Ndisplay and Multi-User Server
Ndisplay is fantastic, but the functionality of the software, especially how the UDP messaging and protocols between the nodes rendering the video/scenes are not well documented. This leads to my next issue.

  1. Currently I am working on implementing remote control web interface to control my editor to forward updates to the frustum, scene, and more. However, because of the lack of documentation on how MU-Server works, and how nDisplay communicates with the render nodes, there is some issue with port conflicts with MU server, as well as changes that arent being synced, and issues with immense amounts of latency between both. Another problem is inconsistent crashes when using both softwares. Has anyone had these issues, and does anyone know what they are/how to solve them?

Thanks!

Hey,

Well I’m sorry to ear you’re having issues using NDisplay/MUServer and the Remote control tool

I myself had countless issues regarding this setup

MUSession works in a certain way.
You have to Create your project
Plugins to enable : Switchboard, Web Control Remote
Go to Project Setting → Enable Multi UserBrowser tab
Restart
Sync all machine with the exact same project, launch the switchboard on the Master computer + the switchboardListener on BOTH machine.
Go to the switchboard setting and check “Auto-join” in the MultiUser session tab
Add devices → NDisplay | Add devices - > Unreal (The Unreal one needs to be the Master IP you’re using the switchboard on, really important to get the MUSession works)
Once that done and everything is connected, close your Unreal Editor
Launch Unreal From the switchboard in order to get the MultiUserSession terminal to start and join
Once Unreal is open go to the MultiUserSession Tab and you should see Node1 connected which is the computer you’re on
Now you can launch the NDisplay from the switchboard by clicking on the up arrow and it should connect to the MUSession properly

Important : Once you done with your session, leave it from the MUSessionBrowser tab and persist changes (or not) so it applies all changes to your machine
If you want to change session : Close Unreal, on the bottom left on the switchboard window change the name of the session, close the MUSession terminal, and launch Unreal first (always launch Unreal first) and once Unreal is open launch the Ndisplay. Avoid doing both at the same time. Especially if you’re using MUSession
Note : If there are changes, on your session, wait until your Unreal Editor loads all the changes first before launching the NDisplay, sometimes it can crash

Ok now for the Remote Control

All you need to do is to open your router ports so you can access your Web interface from your public IP, not your firewall

See this video from Shaun Foster that explains perfectly how to set it up : (VP) Collab Control! Web Remote (4.27) & Level Snapshot (VP) Unreal - YouTube

Once done if you’re using MUsession at the same time as RCtool it should be instantaneous when changing the settings

Hope I bring some help here

See you!

1 Like

Hey. Thanks for your reply. I just wanted to double-check something. When I start the ndisplay session and I try to do some colour correction from remote control or the stage app, all the changes are not applied to the ndisplay directly, rather I have to stop and start the session again. By the way, I am using the ndisplay launcher and not the switchboard, since I have a single cluster setup. Unreal version 5.2.1

When launching from the switchboard controller, do you see your computer connected to the Multi-User session ?

Well, i don’t use switchboard at all since i use a single cluster node. I just use the ndisplay launch plugin, which let you to launch directly the ndisplay if you use only one pc.
Do you think that i have to use switchboard so the remote control will work properly?
The funny part is when i do changes from the remote control app, all the changes are visible at my normal viewport but not on the ndisplay window

I never used the ndisplay launch plugin but only the Switchboard Listener + Switchboard with nDisplay
Maybe try it with the switchboard to see if this work that way

I tried that as well, but when i launch webcontrol on my browser all the settings say that are not bound

That is weird, I’ll try that later and see if I can get it working on the same machine

long story short i made it work,(somehow) i have to replicate the steps. I used switchboard and multiuser session. But the main difference is that I used the ndisplay launcher and the webcontrol has a setting to be included into the multiuser session. I am not explaining it very well now… but as soon as I have the steps ironed I will keep you posted

Ok so i didnt use switchboard. I used the ndisplay launch and the multiuser session plugins.
In order to use webcontrol in one computer you have to run ndisplay launcher and check the option “connect to multiuser” the webcontrol app if you configure it on the port 30000 (default) you have to use the same port for the multiuser session. when you launch ndisplay don’t check “close editor on launch” because you will not be able to control your mouse. Then open your webcontrol app and then you will be able to make adjustments to your ndisplay!

1 Like

Glad you made it work ! :grinning: :+1:
Thaks for the update, hope it help futures devs