Augmented Reality for UE4

[AdamHorvath]

Plugin available on the link below:
http://ar.uplugins.com

[UPDATE]
AR version of the Matinee fight scene demo.:

Interaction DEMO video:

Hi everyone,

After working on this for quite some time, I wanted to show my first results.
I am developing a C++ code plugin that adds AR capabilities to Unreal Engine 4.

The videos below are featuring simple marker tracking examples based on the open source ARToolkit library. The DEMO can detect and track 2 markers at the same time.
Currently it is just a "proof of concept" running on Windows and Android, but I hope to release it as a plugin soon!

Inside UE4 editor on Windows:

Running on Samsung S4 mini:

Hope you like it!

[serioussam909]

Do you plan adding Linux support? ArtoolkitX runs on Linux as well.

[AdamHorvath]

The latest version of the plugin, is only working with 4.22.

If you need the previous version for 4.21 please drop me an email to info@uplugins.com with your order id.

Here's a pretty detailed description of how I set up a brand new project to get the files tested.

1) I create a brand new project with the following settings https://imgur.com/a/JbTgx3n using Unreal Engine 4.21.0

2) I make sure the project settings are properly configurated for android https://imgur.com/a/FufOqJd

3) Then, I move the sample project files from the ARPlugin_PERSONAL_v1_14 into the directory of the new project. https://imgur.com/a/Zaw2Wdr (Partially Norwegian, but it basically says "there are 3 files in the ARTest4 directory with the same name, do you want to replace them" to which I mark that I want to replace the 3 files in the ARTest4 directory with the files from SampleProject.

4) As per the "Getting started" guide, I then refresh Visual Studio 2015 and get this prompt https://imgur.com/a/KeriRZd to which I say "reload"

5) I exit UE4 and relaunch the project getting this prompt https://imgur.com/a/fzWvm9c which I click "yes" to

6) When it is about to launch, I get this message https://imgur.com/a/JAPXEV5 and I just click "ok"

7) When it's launched, there are NO files in ANY of the folders https://imgur.com/a/3TASxM1 and I'm in an empty map with nothing in the World Outline

8) When I try to launch the game on my Honor 8 running Android 7 (It does not support ARcore) I get the following errors https://imgur.com/a/gyjti3b and ultimately when it launches, its just a black screen.


I hope me being detailed helps track down any possible mistakes I've made, and hopefully it wasn't overly detailed. Either way, thank you for the help in fixing this!

[TheOMGman]

Here's a pretty detailed description of how I set up a brand new project to get the files tested.

1) I create a brand new project with the following settings https://imgur.com/a/JbTgx3n using Unreal Engine 4.21.0

2) I make sure the project settings are properly configurated for android https://imgur.com/a/FufOqJd

3) Then, I move the sample project files from the ARPlugin_PERSONAL_v1_14 into the directory of the new project. https://imgur.com/a/Zaw2Wdr (Partially Norwegian, but it basically says "there are 3 files in the ARTest4 directory with the same name, do you want to replace them" to which I mark that I want to replace the 3 files in the ARTest4 directory with the files from SampleProject.

4) As per the "Getting started" guide, I then refresh Visual Studio 2015 and get this prompt https://imgur.com/a/KeriRZd to which I say "reload"

5) I exit UE4 and relaunch the project getting this prompt https://imgur.com/a/fzWvm9c which I click "yes" to

6) When it is about to launch, I get this message https://imgur.com/a/JAPXEV5 and I just click "ok"

7) When it's launched, there are NO files in ANY of the folders https://imgur.com/a/3TASxM1 and I'm in an empty map with nothing in the World Outline

8) When I try to launch the game on my Honor 8 running Android 7 (It does not support ARcore) I get the following errors https://imgur.com/a/gyjti3b and ultimately when it launches, its just a black screen.


I hope me being detailed helps track down any possible mistakes I've made, and hopefully it wasn't overly detailed. Either way, thank you for the help in fixing this!

[AdamHorvath]

It works with the normal launcher version of UE 4.22, don't need to use the source version.
Can you please send me a screenshot of the "pop up to replace 3 files" ?

Hey

Thanks for replying. Copying the files within SampleProject over to the new project (which is a basic template c++ for android development with no starter content) directory, and I get the pop up to replace 3 files, which I click yes on.

I have a suspicion that I'm meant to use the source version of the Unreal Engine 4 to do this, is that correct? Currently I'm using the normal version.

[TheOMGman]

Hey

Thanks for replying. Copying the files within SampleProject over to the new project (which is a basic template c++ for android development with no starter content) directory, and I get the pop up to replace 3 files, which I click yes on.

I have a suspicion that I'm meant to use the source version of the Unreal Engine 4 to do this, is that correct? Currently I'm using the normal version.

[AdamHorvath]

Hello,

I think something is wrong with your project files, make sure to copy all files from the SampleProject directory to your new project directory, not the SampleProject directory.
There should be no errors when opening the project.

The sample project has two demo maps one is the Chair demo, the other is the advanced demo with the motorcycle. Both of the maps are located in the Content/Maps directory.
The default map is the motorcycle demo. If all the files are copied to the proper location you should see / and run the demo on windows with any webcam, and launch on Android and iOS devices.

http://ar.uplugins.com/getting-started-full-version/

Hey

Actually, I may believe I'm issues installing your plugin afterall.
Judging from the name "sample project" and the fact that step 9 in the android section tells you to launch it, I think it's meant to be as a DEMO of some sorts. But when I launch it, it doesn't work as its just a black screen. But the warning starts before then.

First, When I launch the project, I get the error that there's no default map.
Secondly, inside of the content browser, there is the "ARToolKit" folder which has "Data" and "DataNFT" subfolders, but everything is empty.
Third, when I do try to launch it, I get a lot of errors https://i.imgur.com/SesKO4f.png but in the end it will launch, but it'll just be a black screen on my phone.

I know I've followed the steps in the android section, but it doesn't seem to work. The only saving grace that makes me think that I have it installed correctly is that if I go into level blueprints and turn context off, I can access all the blueprints it seems. The only thing I believe may be the problem is this section at the end of your getting started documentation.


Why do we need to compile the plugin from source ?

In Unreal Engine there is no way to package a project that includes a plugin without it’s c++ source code. Also it’s not possible to package a blueprint project with code plugins. Fortunately UNREAL4AR comes with full C++ source code, which makes possible to package any project on any platform.


But I'm not exactly sure what you mean by that? Does that mean I have to download the source code version of Unreal Engine?
As always, any help is much appreciated.

[TheOMGman]

Hey

Actually, I may believe I'm issues installing your plugin afterall.
Judging from the name "sample project" and the fact that step 9 in the android section tells you to launch it, I think it's meant to be as a DEMO of some sorts. But when I launch it, it doesn't work as its just a black screen. But the warning starts before then.

First, When I launch the project, I get the error that there's no default map.
Secondly, inside of the content browser, there is the "ARToolKit" folder which has "Data" and "DataNFT" subfolders, but everything is empty.
Third, when I do try to launch it, I get a lot of errors https://i.imgur.com/SesKO4f.png but in the end it will launch, but it'll just be a black screen on my phone.

I know I've followed the steps in the android section, but it doesn't seem to work. The only saving grace that makes me think that I have it installed correctly is that if I go into level blueprints and turn context off, I can access all the blueprints it seems. The only thing I believe may be the problem is this section at the end of your getting started documentation.


Why do we need to compile the plugin from source ?

In Unreal Engine there is no way to package a project that includes a plugin without it’s c++ source code. Also it’s not possible to package a blueprint project with code plugins. Fortunately UNREAL4AR comes with full C++ source code, which makes possible to package any project on any platform.


But I'm not exactly sure what you mean by that? Does that mean I have to download the source code version of Unreal Engine?
As always, any help is much appreciated.

[TheOMGman]

From what I could see though, that tutorial is either somewhat outdated or it doesn't show the full picture.

Would it be possible to get:
A) Get a quick video that shows how one would make a very basic setup, like how to make the chair demo for android from start to finish.
B) Get a written guide of how to make the chair demo for android.
C) If you still have the Unreal project for the chair demo, you could simply make that available (but remove the plugin files to avoid people essentially getting the plugin for free, that way paying users only have to re-import them)

Option C is probably the most viable, as it would require the least amount of work I presume, and it would still be extremely helpful.

[AdamHorvath]

Hello,

You can find a great tutorial on the link below:
http://safefromrobots.com/?p=149

I hope it helps!

Hello there

I've fairly recently purchased a license for the plugin, and while I can get the plugin installed nicely without any issues, I am a bit dumbfounded as to how you start it.
I'm aware of the documentation, but I've never really been good at understanding those, you don't seem to have any basic setup examples, so it's a bit difficult to know where to even start, given that this is my first trip into AR.

Is it possible you could provide some guidance? I've already done a quick skim search through this forum, but didn't see anything.
Just some quick screenshot of a blueprint setup for how to get something like the chair projection working would be nice, since that's more or less what I'm doing, except I'm gonna use a different 3D asset.

For the record, I'm building an android project, the phone I've got is an Honor 8 (running on Android 7)

Second question, would there be any issues installing this plugin on an already existing android c++ project? I would assume not, but figured I'd ask.

Any help is appreciated, thank you in advance.

[TheOMGman]

Hello there

I've fairly recently purchased a license for the plugin, and while I can get the plugin installed nicely without any issues, I am a bit dumbfounded as to how you start it.
I'm aware of the documentation, but I've never really been good at understanding those, you don't seem to have any basic setup examples, so it's a bit difficult to know where to even start, given that this is my first trip into AR.

Is it possible you could provide some guidance? I've already done a quick skim search through this forum, but didn't see anything.
Just some quick screenshot of a blueprint setup for how to get something like the chair projection working would be nice, since that's more or less what I'm doing, except I'm gonna use a different 3D asset.

For the record, I'm building an android project, the phone I've got is an Honor 8 (running on Android 7)

Second question, would there be any issues installing this plugin on an already existing android c++ project? I would assume not, but figured I'd ask.

Any help is appreciated, thank you in advance.

[rajpootathar]

how to get demo version?

[Invius]

I can't tell, never used ARCore with the plugin together. Did you try with different marker ? Did you set the init node to portrait mode ?

AdamHorvath And are you able to provide any kinda of support? We've purchased the commercial version of this because we have clients that require a more accurate image tracking then what's provided by the ARCore.

I've reported this to Epic, maybe they can fix this on their part:
https://answers.unrealengine.com/que...ns-like-a.html

For everyone else that is thinking of buy a commercial version, please checkout this build, its for Android, here you can experience the problem between the 2 plugins.
https://mega.nz/#!VBFiEQST!JDOT0mpfE...aMoL_ZrSEchzPg

Video to show whats happening:

[AdamHorvath]

I can't tell, never used ARCore with the plugin together. Did you try with different marker ? Did you set the init node to portrait mode ?

AdamHorvath Is it possible to fix this? The problem between ARcore and your plugin?

[Invius]

AdamHorvath Is it possible to fix this? The problem between ARcore and your plugin?