Hello all,
I have the majority of this figured out (albeit very buggy). I’m using a similar method of finding the camera’s rotation, but I’ve also included a way of (mostly) correctly finding the right field of view of the SceneCapture2d. By using the law of cosigns, and knowing the portal size, we can draw vectors to two sides and find the angle from there. This has lead to some odd distortion when up close, likely a result of the angle estimation I used. I’d be interested if anyone can fix this, but for distant portals I think this method is workable.
[video]Portal WIP - YouTube
*OP and BP correlate to the orange and blue square frames in the world. And I know there’s a lot of extra fluff in there, I’m pretty new to blueprints/programming in general lol.