Hello Unreal Engine Community,
I’m currently developing a VR project in Unreal Engine that involves creating a 10x10 meter virtual environment corresponding to a real-world space. To ensure precise alignment between the virtual and physical environments, I’m considering using ArUco markers for calibration. My goal is to detect these markers and adjust the VR pawn’s position and orientation within Unreal Engine to match the real-world coordinates accurately.
while trying to make this thing work on a Quest 3 HMD passthrough RGB cameras, i recently discovered that the API Meta provides developers wich allows to integrate the passthrough feed into applications does not provide raw RGB camera access or real-time unprocessed video streams that you can manipulate directly with libraries like OpenCV. so i’m considering to use esp32-camera and mount it on the HDM and use it as a aruco marker detecter instead