No announcement yet.

Augmented Reality for UE4

  • Filter
  • Time
  • Show
Clear All
new posts

    [PLUGIN] Augmented Reality for UE4

    Plugin available on the link below:

    AR version of the Matinee fight scene demo.:

    Interaction DEMO video:

    Hi everyone,

    After working on this for quite some time, I wanted to show my first results.
    I am developing a C++ code plugin that adds AR capabilities to Unreal Engine 4.

    The videos below are featuring simple marker tracking examples based on the open source ARToolkit library. The DEMO can detect and track 2 markers at the same time.
    Currently it is just a "proof of concept" running on Windows and Android, but I hope to release it as a plugin soon!

    Inside UE4 editor on Windows:

    Running on Samsung S4 mini:

    Hope you like it!
    Last edited by AdamHorvath; 02-22-2018, 06:23 AM.
    AR plugin for UE4
    AR Virtual Mirror plugin for UE4
    Red Alert 2 VR remake
    Armed Island VR RTS

    You sir, are a legend

    Looking forward to seeing how it goes...


      Yes yes yes yes so muuuch yessss!


        Awesome, You Rock!
        Michaell Bakalars
        Creative Director
        Sprout Concept


          That is pretty big time impressive.
          Acclivity Game Studios. Making a BP FPS, Tutorial Series on Blog : On Unreal Wiki : Twitch


            OMG, I will buy this so hard!
            Carlos Montero | @cman2k | Technical Art Director @neoglyphic
            Working on Sunborn Rising and the Neofur Plugin | I made Black Mesa


              This is too good. Got to try this.


                Yeah, this is ridiculously awesome! Can't wait to see more.
                2B || (!2B)


                  Looks very promising, keep up the good work!
                  ArtStation - Portfolio


                    Yeah, this is really amazing ! Keep it up !


                      Wow,...loved it!

                      Python for Unreal Engine Editor Tools Scripting

                      Check my games & tutorials !


                        Will definitely be keeping up on this thread
                        Theia Interactive makes immersive VR experiences in collaboration with the world’s leading companies and creatives, leveraging this bleeding edge technology to pioneer the next generation of entertainment, storytelling, and customer engagement.


                          impressive !!!!!!! when does your plugin will be in test or released ? and at wich price ? could be very usefull for my work !! thanks


                            I'm starting to see some light at the end of the tunnel
                            Keep it up!



                              I've uploaded a very early binary version of the upcoming AR plugin with a sample project.
                              Currently it works only in the UE editor (on Windows), and all of it's features can be used with blueprints. No C++ coding required!

                              I've tried to keep everything as simple as possible.

                              Opinions / suggestion are welcomed!

                              How to test ?

                              1. Download the file on the link below and unzip it's contents to your UE4 project directory.

                              2. Print the markers located in ARSample\Plugins\ARToolkitPlugin\Binaries\Win64\Data\pdf

                              - There are 4 markers here: Kanji , Hiro, Sample 1, Sample 2. (Print at least Hiro, to get started!)
                              - Make sure to print them in their original size, and there should be a white border around the marker.

                              3. Run Epic Games launcher, and install Unreal Engine 4.9.2

                              4. In Epic Games launcher open ARSample project

                              5. Connect your webcam, and press the play button inside the editor!

                              6. Video stream should appear, move the markers (Hiro / Kanji) in front of the camera

                              7. Default unreal 3D chairs should appear on the screen.

                              More info about marker tracking can be found on the following link:

                              There are two main blueprints in the example:

                              ARToolkitBase blueprint

                              - Default webcam init (640x480 default resolution)
                              - Initializes the video stream and creates a dynamic texture based on the baseFeed material
                              - Loading markers (Marker list can be edited in the Markers enumeration - Content browser: Contents/ARToolkit/Blueprints/Markers
                              - Cleaning up at the end.

                              Level blueprint

                              - Transformation of the "chairs" based on marker positions / rotations.

                              CubeHiro, CubeKanji

                              - Simple static meshes - Feel free to change them!

                              Last edited by AdamHorvath; 10-07-2015, 03:32 PM.
                              AR plugin for UE4
                              AR Virtual Mirror plugin for UE4
                              Red Alert 2 VR remake
                              Armed Island VR RTS