The brute force option is to just hide the head when rendering from the players perspective. There shouldn’t be any point in rendering it either way, apart from shadows and reflections.
I thought about this but I would need to create a dynamic material mask that changes depending on the owner. But then I imagine I would still be able to see inside the rest of the body as well?
I’m gonna try a different approach. I just watched this tutorial and noticed that the VR scene is a child of the mesh. Just set it up myself and it looks plausible. I’ll test it when I can and report back.
Okay that did NOT work. So I decided to work with the interpolation from the mesh to the camera location. The trick was to change the “Mesh World Location” to the “HMD_Socket” location instead. FABRIK is not enabled. Everything works flawlessly now.