Interact with Widget on custom Shape

Hey,

So i’ve been trying to make a widget appear on a custom mesh. And after fiddling around with it, i managed to create the render target and render it to the meshes surface. The problem now is: How do i interact with it. I was planning on using the Widget Interaction Component, but that doesn’t seem to work. Then i tried to utilize the Custom mode on the Widget interaction component, but wasn’t sure if that is the right way to do it because i don’t know in what space the hit test would be expected. I was thinking to use the face index found by a manual hit test and calculate the UVs from that, but how would that translate to a hit result for the component? Also this custom face index wouldn’t work if i decide to use a skeletal mesh in the future, or at least be somewhat expensive and complicated … And then i thought, shouldn’t there be an easier way?
I do this for a VR Game, and i have a book (#original) that the player can open (skeletal mesh animation for the pages turning, eventually?) and the pages itself are slightly bend, so a widget component isn’t convincing. So my questions: Am i approaching this the wrong way? Can i use Widget Interaction Component for this? Is the manual hit test to uv approach feasible?

Thanks in advance!