ARCore/ARKit SDK Updates

Porky_Grout · February 5, 2018, 9:17pm

Thanks for the update. I was able to get the face geometry showing using the Handheld AR template as a starting point. Just involved changing the tracking mode at start to Face and then adding a FaceMesh component. The settings for that were a bit tricky but it is working now.

Currently seeing if we can pipe in the directional light info through the code like it is doing with the Ambient.

das8track · February 9, 2018, 6:16pm

I haven’t been on this thread is a while and I’ve missed out on a lot of great info! Thanks to everyone posting, especially those from Google and Epic. I’m really excited about the added features and fixes coming in 4.19 for ARCore. I have yet to dive into ARKit yet but the plane detection and lighting changes are something I’ve been really wanting!

anonymous_user_2e9c824d · February 12, 2018, 9:51pm

Further update on my progress. I now have Primary Light direction and intensity coming from ARKit into the scene with the face mesh component. Works great and is really responsive. Working now on bringing the SH secondary lighting over. If anyone has done customization of the baked SH light probes in Unreal, let me know since I am not sure how similar the values are to the ones UE4 wants.

For the directional light, I just had to convert the coordinate system of the light direction to unreal.

DrHobo · February 16, 2018, 9:41pm

[USER=“14973”]Chance Ivey[/USER] I can only see a Blueprint version. Is C++ going to be available ?

Ivey · February 19, 2018, 2:46am

We’ve talked about it but nothing currently in the works. If there’s a growing need for it, we’ll revisit!

Ivey · February 19, 2018, 2:48am

On that note, the whole BP Function Library for the AR API is available in C++, so you can see what those calls look like directly in the code.

darinsmyth · February 23, 2018, 8:43pm

Chance Ivey:

Hey there! Glad to see so many people diving into AR development with UE4. Here’s a little insight into our plan:

In 4.19, you’ll find improved support for ARKit and a full implementation of the ARCore Developer Preview 2 mentioned by Bo above (thanks for dropping the info, Bo!)

As we do with most platform types, we’re currently building out a robust API that will ease cross-platform development by unifying the workflows of interacting with the platform SDKs. This will first show up in 4.19 and get updates going forward.

Also with 4.19, we’re looking to release a handheld AR Template in the editor that will come preconfigured with examples of plane detection, object spawning, uses of light estimation, pass thru camera, debug information and more.

Docs will be coming online in the 4.19 timeframe as well as our implementation will be a bit more concrete.

We’re currently working on adding support for Apple’s face recognition tech on the iPhone X, though the timeframe on delivery there is still a little uncertain.

Going forward, we’ll continue to add features and functionality as they come online at the platform SDK as we do with other integrations into the engine.

The goal is to help you get moving, iterating and shipping with as little friction as possible. We’re big fans of these platforms and can’t wait to see more of what you all are able to do with them

Hi Chance,

Any possibility ARCore 1.0 can be integrated in to 4.19??

Mr.Swazzy · February 25, 2018, 9:09pm

Since Google did a full release of ARCore 1.0 last friday, will we be able to see it brought into the full release of 4.19? Any chance of vertical plane detection as well since ARKit 1.5 and ARCore 1.0 now support it naively?

aussieburger · February 26, 2018, 10:40am

+1 for ARCore 1.0 support in 4.19!

LaurentLKO · March 2, 2018, 10:18am

Hello

Will ARKit 1.5 support in 4.19 ? With wall detection and tracker recognition ?

Would be great

BLRRD · March 5, 2018, 11:50pm

Also interested in knowing whether ARKit 1.5/ARCore 1.0 support will be in 4.19. I want to start on an AR app that I’ve been thinking of for a while, but the idea behind it requires vertical plane support. Would be awesome if a staff member could chime in!

astronX · March 12, 2018, 3:01pm

Any solution on scaling the whole level or sub-level on ARKit/ARCore in 4.19? Sample blueprint just spawned geometries that were already scaled by 0.1.

smbv1 · March 13, 2018, 3:55pm

I got small request for image-based tracking (logo) project animation in AR for either iOS or Android, can I expect image-based tracking option in 4.19? Does anybody hear anything about it?

anonymous_user_630f024f · March 26, 2018, 9:52pm

Hey :

Thanks for the feedback on what you are able to do so far. Can you also explain what settings were tricky and where you added the face mesh component?

Thanks!

smbv1 · March 28, 2018, 1:30pm

I have updated (automatically) from Android7 to Android8 on my Samsung S8 and since then I’m not able to run applications from Unreal Engine, even older versions that I made in 4.17 (and 4.18.3). As I understood there is no support of ARCore in Android 8 on every phone, only way is to revert your phone back to Android7 which I have to do now with lossing all data and installing it over again.

anonymous_user_630f024f · April 6, 2018, 8:02am

Has anyone had luck occluding other 3D meshes using the ARkit face mesh that can be generated?

Afox · May 17, 2018, 3:03pm

I’ve notice the Google AR Core download is only for a very small selection of devices. Any Idea on how to utilize the UE4 AR Template with out using the Google ARCore?

solodev · May 22, 2018, 2:54pm

[USER=“14973”]Chance Ivey[/USER] if you could chime in and enlighten us how AR implementation is going, I guess both ARKit and ARCore. I’m doing R&D as far as ARKit is concerned however it seems that the ARKit integration is quite basic. Can’t seem to track based on points, only horizontal plane, the tracking is clunky. Can’t find any kind of docs on the topic. Things like scaling the camera/world, visualizing plane/points detected etc. would be great to have explained a little bit more.