Download

Using ARkit for full tracking while inside VR

Havent be able to find an answer to this sort of thing so thought i would check here. I was thinking of maybe utilising full face tracking inside a VR game I am developing. I know that eye/eyebrow tracking can be done with the vive eye pro and that an addon module for lip tracking has been created but it is next to impossible to get your hands on it at the moment as they have only released a very limited number for testing purposes with no word of a possible consumer release.

So as a possible alternative I considered maybe using iphone/ARkit combo but no info on how well the app works if the face is partially obscured. Is it possible to combine the VR tracking methods inside a vive eye pro while the ARkit handles mouth/jaw at the same time and live link stream both into unreal for realtime feedback?

Thanks