Announcement

Collapse
No announcement yet.

[ARkit] Object detection. Who has a guide?

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    [ARkit] Object detection. Who has a guide?

    The best I've found here.
    https://docs.unrealengine.com/en-us/...ort-in-UE4-420

    I need to scan my model and upload it to the cloud. But I have no idea how to do it (

    #2
    Have you succeeded? Would be interesting to know how to use that feature.

    Comment


      #3
      Need a guide for Object Tracking, too. Big client will kill me if it doesnt work, because I promised them it works, because it is listed as feature in the documentation of the engine but no documentation there to get it to really working.

      Comment


        #4
        I have a kit on the marketplace that includes object detection for IOS devices: https://www.unrealengine.com/marketp...eality-toolkit It also comes with a guide.


        If you're not interested in the kit but would like help with object detection here are the steps I used (ARKit only):

        1 - Set your session type to "object scanning"
        2 - visualise the AR point cloud with debug points so you see what the ARkit is scanning
        3 - use the "Get AR candidate object" node to capture the object when scanning it with your device
        4 - Save the captured object data to a slot on your device
        5 - Use iTunes to access the save file on your device
        6 - load the save game from within the blueprint construction script to set public variables in a blueprint
        7 - Drop the blueprint into the world, the object data you scanned should now be visible in details panel
        8- Copy the data from the public variables
        11 - Create an "ARcandidateObject" by right clicking in the content browser then /misc/data asset
        12 - paste all the data in here
        13 - add the ARcandidateObject to the AR session config
        11 - change the session type to world
        12 - in your AR pawn blueprint add these nodes: event tick - get all ar geometries - for each loop - cast to AR tracked object - get detected object - get friendly name - equals (the friendly name of your object) - branch - (if true.....whatever you want to happen when the object is detected)
        Last edited by xadamxful; 05-17-2020, 08:26 AM.

        Comment

        Working...
        X