Ndisplay collab template stuttering

I’m using the collab template in our VR Cave together with ndisplay. When i connect the master node in the ndisplay cluster to a session (local on the master node) the navigation in the Cave gets choppy. It looks like it is not syncing fast enough?

Has anyone tried this? any pointers?

also the remote player’s avatar is not visible in the Cave, not sure how to distribute it to the rest of the cluster.