Augmented Unreality - AR plugin for UE4

StefanCG · March 7, 2017, 6:38am

Ah that would be really nice and does it build for android and ios phones?

anonymous_user_d868c905 · March 7, 2017, 1:24pm

The new version works on Android, that is the biggest update
I have not tried iOS because there is no cross-compilation for it, but the underlying OpenCV library is known to work there so it should be possible to build for it.

I am working on the package and should have it later today.

anonymous_user_d868c905 · March 8, 2017, 12:12am

Ok so the current version is uploaded.
If you need help with something, let me know.

Enter_Reality · March 9, 2017, 7:50am

Cool, gonna try it next week for some projects I’m working on.

Just to bettere understand how it works, I have a couple of questions:

Reading the documentation I can see that you’re able to use boards indipendently and you’re also able to set a condition where the actor follows the position of the board…this also mean thatif I try to move the board around the enviroment the tracking will still work? I’m doing the same thing in Vurofia in Unity, and the tracking when the marker is moved around is quite strong, so I was wondering if using those boards in the same way give the same results
Can you make custom fiducial markers? Also, can you have a custom size for the boards? I would like to add text on each boards and shrink them down quite a bit ( say 5cmx5cm )
Camera calibration is done once and that’s it, correct?
What would be the best way to implement on-screen buttons? I’m building a custom UI using the UMG 3d component for what I’m developing with the Vive, but I would like to know if the addition of on-screen buttons ( to play an animation or to switch the spawn mesh ) can be integrated easily

Thanks for sharing the plugin, can’t wait to run some tests!

anonymous_user_d868c905 · March 9, 2017, 9:35am

There are two roles of boards:

Position the camera in the level - moves the camera actor in UE’s world.
Position tracked objects (those with a tracking-component) - many objects can be tracked at once.

You can change the size of markers (example in video)](https://youtu.be/Ys8br7AKW9g?t=2m55s).
But for the actual pattern on the marker, only ArUco is allowed, because the plugin finds all ArUco patterns from all boards in one pass, then passes them to each board for pose estimation.

Yes, once per camera - we need to find the focal length. Then the calibration result is saved to a file. If you know the camera’s focal length beforehand, you can write that file and skip calibration.
On Android the calibration may not even be necessary, because Android API gives the FOV angle (and the plugin uses it when no calibration was performed) - I don’t know how accurate that is however.

I use simple 2D UMG UI in the example project. A widget used to control the AR system is provided. The AR video stream is shown in the background and does not interfere with any UI.

anonymous_user_07f51cc2 · March 15, 2017, 9:48pm

Hi,
I am new to unreal, so it would be great if you could help me out with a problem I am facing. I would like to add the plugin to an empty project, but I cannot find the AURCameraActor. How can I add it to the scene? I can see there is a .uasset file for it, but I cannot find how to place it.
It would be great if you could point me in the right direction.
Thank you!

EDIT> found it! All i had to do was enable “show plugin content” in the view options of the content browser (bottom right corner). Thanks a lot for the great plugin!

anonymous_user_d868c905 · March 17, 2017, 10:49pm

To see the plugin’s classes in content browser, set “Show Plugin Content”

calvin019 · June 13, 2017, 2:37am

How to I get the actors (cubes) to go away when the marker is not there?

anonymous_user_fd0feb45 · July 26, 2017, 5:59am

Dear ,
Do you mean in your post about ios that if I work on a mac machine, I can surely build for ios and android?
Thank you very much

mhnoni · March 15, 2018, 10:48pm

Hi thank you so much for this amazing pugin

Total noob question here, can you please tell me which android version my phone need so it can run the packaged version of the game that contain this plugin? My android is 2.3 its very old but it run most of the google AR apps so i wounder if its capable to run this one.

Thanks

DanielDurys · March 22, 2018, 2:43pm

Hi, can we get some video tutorial?

jakwarne · March 22, 2018, 3:55pm

Hi ,

Thank you for the project, it’s very helpful, but i’m having a hard time getting the tracking to work smoothly with my Samsung Galaxy s8.

In your image here the colours that represent the calibration happening are very clear, but when i do it the colour only flash for a second and disappears as if it isn’t really recognising the marker.

https://camo.githubusercontent.com/26e0d44c8bb7a1cae3f51af4caba4a470d47bdeb/68747470733a2f2f706f6c79626f782e6574687a2e63682f696e6465782e7068702f732f595a327751706437746e47427267682f646f776e6c6f6164

…and after the calibration is finished the tracking is very slow, if i move the camera too fast the object moves as well a lot.

You mentioned being able to manually enter the devices FOV, which might help, where is this file saved to edit it?

Also would manually entering the devices resolution help as well?

And like ‘DanielDurys’ mentioned I would love to see a short tutorial if possible. For me it would be great to see how to set up multiple markers for the same object to make the tracking more stable.

Thanks