How do you send commands/keystrokes/mouse clicks to an external application?

Stuff like this has been asked but after searching I can’t find anyone who has given a real answer to this niche use case.

I was thinking of making a custom interface in a game that allows you to

  1. See the window of another external application
  2. send input to it at runtime (I want to send custom macros to perform actions quicker than just using the original application’s tools alone as intended)

Sort of like virtual desktop but with very specific and custom controls for controlling a specific program.

Well, assuming you have control over the other application, you can implement any kind of IPC that you want, websockets, webservers, file system sockets, whatever. The specific purpose, though, doesn’t seem particularly well suited to Unreal, though…

The specific purpose, though, doesn’t seem particularly well suited to Unreal, though…

What tool would be well suited for what I want to do that is also capable of creating a fully immersive interactive environment for the user?

This is what Virtual Desktop is incase that wasn’t clear: https://www.youtube.com/watch?v=bjE6qXd6Itw

This is closer to what I want to do: https://www.youtube.com/watch?v=k8XvW7bFPU4

now that sounds more like the part that Unreal is better suited for :slight_smile:

Yeah, so how exactly would this be done? Especially the Premiere in VR example?