I should have added in my post that you need to set “follow HMD orientation” to true in your PlayerCameraManager.