Augmented Reality Virtual Mirror plugin for UE4

Community Showcase Game Development
1

**Get the plugin from the following link: **http:/mirror.uplugins.com
**Updated DEMO link using the latest 4.25 version: **https://drive.google.com/uc?id=1iSkP…xport=download

Hi everyone,

I’d like to introduce my second Augmented Reality project for Unreal Engine 4, a full featured virtual dressing mirror.

Key features:

  • Accurate avateering
  • Automatic fitting, based on joint positions
  • Easy import pipeline from Adobe FUSE (this demo is using clothing from Adobe FUSE)
  • Customizable gesture controlled user interface built with UMG and blueprints.
  • APEX clothing simulation
  • Try on multiple clothes at the same time
  • 3D hand occlusion / 3D masking (experimental, check out the end of the video!)
  • Image based lighting
  • Photo booth functions with social media sharing (currently Facebook sharing to a predefined page is supported)
  • White label solution

Supported motion sensors:

I’ve made custom C++ integrations (with exposed blueprint functionality) for all type of sensors listed below

  • Microsoft Kinect for XBOX ONE - Kinect V2.0 (MS Kinect V2.0 SDK)
  • Asus XTION Pro (OpenNI2/NITE2)
  • Kinect v1.0 (OpenNI2/NITE2)
  • PrimeSense Carmine (OpenNI2/NITE2)

It will be a great starting point for any virtual dressing / virtual mirror project.
I am expecting to release it as a plugin very soon!

This is a WIP video inside UE4 editor on Windows:

2

Hello This is when it will release download?

3

awesome job, really unbelievable.looking forward to the official version of the release.

4

great job ! this is a really a new standard for mirroring
can’t wait to see more !!

5

Hello,

Please help me to test my Virtual Mirror UE4 plugin!

Download and unzip Virtual Mirror for UE4 DEMO from the following link:
https://docs.google.com/uc?id=0BwYprFg4NSK7VGlMZjZvSlZXS00

Instructions:

  • Plug in, and install your motion sensor!
    (Kinect, Kincect v2.0, ASUS XTION Live, PrimeSense Carmin 1.08 are supported)

  • Place your motion sensor around 150 cm – 200 cm from the floor.
    Make sure the floor is clear. (Around 3×3 m free space is required.)

  • Start the DEMO by clicking on one of the .bat files (start-Kinect_v1.bat - Kinect v1.0 (Kinect, Primesense, Asus XTION) or start-Kinect_v2.bat - Kinect v2.0)

  • Press “F” - for fullscreen mode!

  • Make sure your legs and your head are visible both on the video image, and on the red silhouette!

  • Stand around 2-2.5 m distance from the sensor.

  • Do a little movement, walk a few steps back and forth,so Kinect can recognize you. A red silhouette will appear on the left bottom of the screen.

  • Raise your hands as you can see on the pictogram!

  • After the side menu appears,you can start selecting items from the right menu.

  • You can filter by categories on the left, select women’s, men’s wear, and remove outfit on the top.

  • Adjust the size of your outfit if necessary using “+” and “-” keys

  • Press the photo button on the top to make a photograph of yourself

If you like your photo select “Facebook” to publish your photo on Facebook.

Photos, and some meta data like plugin version , sensor type , fps ) are published on the following test page:

(Published photos will be used only to improve the quality of the plugin.)

Thanks,

1 Like
6

Hey ! Awesome project, I can’t wait to test this out and add some of my own stuff to it!

7

Dear
thanks for your great effort, we will tryout your plug in and promise to test it aand get back with all results,
we wish you all progress and success
when you get sme new please contact us on
thanks again
.

8

Hi everybody,

I am pleased to announce that my Virtual Mirror plugin for UE4 is available for purchase!

Key Features:

  • Accurate avateering
  • Automatic fitting, based on joint positions
  • Easy import pipeline from Adobe FUSE, 3D Studio Max, Maya
  • Customizable gesture controlled user interface built with UMG and blueprints.
  • APEX clothing simulation
  • Try on multiple clothes at the same time
  • 3D hand occlusion / 3D masking (experimental)
  • Image based lighting
  • Photo booth functions with social media sharing (currently “Take photo” and “Facebook sharing to a predefined page” is supported)
  • White label solution, with C++ source code!
  • 100% blueprintable no coding knowledge required
  • Supported platforms: Windows 64bit
  • Compatible with Unreal Engine v4.10 and v4.11
  • Updates for 1 year!

Pricing:

$249EUR - Commercial license with source code!

Get the plugin from the link below:
http://www.unreal4mirror.com

2 Likes
9

New tutorial is available about import clothing assets from Adobe Fuse CC.

Check out on the following link:
http://unreal4mirror.com/adobe-fuse-cc/

More tutorials are on the way!

10

Hi everybody,

I’ve updated the plugin and also fixed some bugs.

Updated DEMO link:
https://docs.google.com/uc?id=0BwYprFg4NSK7VGlMZjZvSlZXS00

VirtualMirror Plugin V1.1 - 2016-06-17

  • Updated to Unreal Engine v4.12
  • Fixed crashing on begin play
  • Minor bug fixes

Get the plugin from the link below:
http://www.unreal4mirror.com

11

Hi,

i just bought the plugin, and the Sample project doesnt work (Executable demo works )
I’m using:

windows 10 pro
lastest kinect SDK
UE 4.12.5
VS 2015

12

Got it working !

Any one has imported Marvelous Designer Cloths to the AR mirror plugin ?

13

Hi, I’m on UE4.12, I have followed your instruction but it’s not asking me to rebuild the plugin and when I run it it just crash. Any idea?
I bought the plugin on 9 august.
This is the error I get if I run the editor with visual studio
Exception thrown at 0xFFFFFFFFFFFFFFFF in UE4Editor.exe: 0xC0000005: Access violation executing location 0xFFFFFFFFFFFFFFFF.

14

Hi, I still can’t run it. Kinect V1. Crash when start playing the project in UE4

15

Hi David,

I am expecting to release the updated version for UE 4.13 . I hope issues will be resolved in the new version.

16

Hi, for wich version 4.12.x is the “old” version compiled? Maybe I’m trying to run it from the wrong UE4 version

17

Hi,

It was on 4.12.2.

I compiled with the new 4.13 and works without any changes, on both Kinect v1 and v2 sensors.
Please have a try if you have some time, and let me know.

18

Demo crashes on start

Hello /All
Hope you are well.

I can’t test it with my kinect v.1 The demo still crashes on the start, is anyone having this problem as well? Any advice? Thanks!

19

Hi
checked out the video and the product looks awesome. I am sort of new to Unreal. I just downloaded the demo module and was wondering if there is a documentation I can go through to install this and run it.
Also was looking at any tutorials with relation to how to run the complete process.

Regards
GP

20

i was wandering how can i save the screenshot to disk as *.bmp, *.jpg or *.png?