Connect Foundry VTT to Unreal

I am looking to create an enhanced emersion for roleplaying games like Dungeons and Dragons. There is a terrific, community-extendable virtual tabletop (VTT) system named Foundry that provides a centralized map, moves player tokens, and computes game rules.

I would like to; 1: create 3D environments in Unreal, then derive overhead maps to use in Foundry (this is straight forward). 2: enable the movement of game tokens in Foundry to puppet a POV camera in Unreal to provide an updated POV (in a 3D environment) as tokens move about, including rotating tokens to look around. This POV would be displayed on a separate screen. Eventually I would like to extend this output to a LED volume.

I’m looking for the best methodology for these applications to interoperate. Foundry calculates line-of-sight for each game token via polygonal blocking, so it is already doing some POV math. Thoughts?

I know it’s been over two years, but I was just researching this exact thing. Did you ever figure this out?