Interaction with objects through render target

Hello everyone.

Is there any convenient way to implement interaction between player and object through game world screen (render target) surface? For example, I have a ball, SceneCapture2D component (camera) pointed at this ball and mesh with material rendered from camera (screen). I want to click on ball on this screen and translate this click via line tracing from camera to original ball in game world.

Any ways I can get this done?

The same question, is there anyone else having any idea?

anyone did solve this?

I have found a solution for this problem. If someone still needs it just say it.

Yes, please.

I would also love to know how to do this. I’ve got a minimap of sorts using a 2d scene capture and I’d love to be able to click on those world objects through the minimap. I was on the track with something using a portal system but I haven’t explored it enough yet. I would love to see if you found a better solution.

I would love to see your solution too.

1 Like

If you still have your solution kicking around I’d be interested.

Oh yeah it’s like 7 Years ago.

But you “just” have to translate it step for step.

  1. First from the Player Screen into the world. There is like a Deproject Screen to World node. You might need to use this data to trace into the world.
  2. Then you Transform this position into the relative position of the display. You can use the invert transform position node. The Position from step 1 and the transform of the display. Now the transform will be in the relative space of the display.
  3. Project it back into the world of the Scene Render Target. The Deproject Screen to world node will not work because it’s for the player camera.
    But you can find a discussion here: Deproject Screen To World and SceneCapture2D. - #10 by SONB

If you use a widget placed in the world there are some build in interactions from the Player world into the widget coordinate system.