How to send device posture information from an iOS application to the UE Editor via LiveLink

Development Pipeline & Plugins
, ,
1

(This is a translation of a [Japanese [Content removed] by Yamamoto.)

I would like to know how I can send device posture information from an iOS application to the UE Editor via LiveLink.

To be specific, if there are any reference materials or information on the following, I’d appreciate it if you could let me know:

(1) Implementation method of the above when developing the iOS application within the UE environment

(2) Implementation method of the above when developing the iOS application outside of the UE environment

Thank you.

2

Hi this was answered in the linked question already. Please see the response in the linked post.

3

[mention removed]​

There seems to be no link I can find. Please let me know about the link.

4

Hello Brooke,

Thank you for your quick response, but there seems to be no link I can find. I’d appreciate it if you could check this.

5

Hi Masahiro, there was a misunderstanding, that I thought this question was a dupe with the original link in the initial question. Apologies for the mix up, and we’ll get this sorted.

6

Thank you for your explanation. We’ll be waiting for the answer.

Thank you.

7

If the iOS application is a UE game, then you should be able to use a LiveLinkProvider (see https://dev.epicgames.com/documentation/en\-us/unreal\-engine/live\-link\-plugin\-development\-in\-unreal\-engine) which uses UDP Messaging to transport Live Link data.

But if the iOS application is not a UE game, then you will have to pick and implement the sender of a supported protocol. For example in 5.6, Unreal supports the OpenTrackIO (opentrackio.org) SMPTE-RIS standard for camera tracking, which seems a good fit for sending the device’s pose.

Prior to 5.6, then you’ll have to pick another protocol, for example LiveLinkFreeD (it supports the 0xD1 packet, see https://www.manualsdir.com/manuals/641433/vinten\-radamec\-free\-d.html?page\=30 or https://pro.sony/s3/2020/08/04144807/BRC\-X1000\_X400\_series\_integration\_manual\_CameraTrackingFunction\_v1\.0\.pdf).

8

[mention removed]​

(This is a translation of a Japanese post by Yamamoto.)

Thank you very much for your reply.

Let me confirm whether I understand your reply about the constraints on UE-side reception. Is it correct to understand that UE is independent of the protocol and can receive information if it is in a specific format (e.g., 0xD1 packet of LiveLinkFreeD)?

Thank you.