AR Application

I want to develop an app that should be able to add annotations to physical objects.
I will need a simple guide on how to me yet unclear things can be achieved.

I want to add multiple annotations to the same object and a single annotation will be displayed for a part of the object. The process of adding annotations should go as follows. The user should be able to freely select an area(free form) on the object and then he types will the text.

How can I in AR using meta quest 3 or android/ARcore select an area on the object? Of course that the physical object will have a unreal Actor that is not visible mapped to it and the selection will basically interact with the hidden Actor.

Like I said just dont do into detail when answering just give me the main Idea/Steps and i will make research on how to do it.

a simple way to do it would be to have the user touch the object on the screen where they want to add the annotation instead of having them select an area.

Then on the touch get the touch coordinates, covert that to 3d coordinates, and pass that to a line trace which can hit the hidden actor. Then get the location from the hit result and use that location to spawn your annotation(s).

Then you’ll need to add a UI widget to have them type in the text. then pass the text to the annotation BP.

-e