Announcement

Collapse
No announcement yet.

Augmented Reality Virtual Mirror plugin for UE4

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Augmented Reality Virtual Mirror plugin for UE4

    Get the plugin from the following link: http:/mirror.uplugins.com
    Updated DEMO link: https://docs.google.com/uc?id=0BwYpr...GlMZjZvSlZXS00




    Hi everyone,

    I'd like to introduce my second Augmented Reality project for Unreal Engine 4, a full featured virtual dressing mirror.

    Key features:

    - Accurate avateering
    - Automatic fitting, based on joint positions
    - Easy import pipeline from Adobe FUSE (this demo is using clothing from Adobe FUSE)
    - Customizable gesture controlled user interface built with UMG and blueprints.
    - APEX clothing simulation
    - Try on multiple clothes at the same time
    - 3D hand occlusion / 3D masking (experimental, check out the end of the video!)
    - Image based lighting
    - Photo booth functions with social media sharing (currently Facebook sharing to a predefined page is supported)
    - White label solution

    Supported motion sensors:

    I've made custom C++ integrations (with exposed blueprint functionality) for all type of sensors listed below

    - Microsoft Kinect for XBOX ONE - Kinect V2.0 (MS Kinect V2.0 SDK)
    - Asus XTION Pro (OpenNI2/NITE2)
    - Kinect v1.0 (OpenNI2/NITE2)
    - PrimeSense Carmine (OpenNI2/NITE2)

    It will be a great starting point for any virtual dressing / virtual mirror project.
    I am expecting to release it as a plugin very soon!

    This is a WIP video inside UE4 editor on Windows:

    Last edited by AdamHorvath; 03-23-2018, 06:20 AM.

  • replied
    Hello Decky,

    I am glad it's working now!

    The background change feature is not implemented by default, but it's not that hard to add it.
    Currently the system has a background plane with a video texture. It's the output of the get camera frame node with RGB type parameter.

    This node also has a user type output which can be used as an opacity mask to show only the user , and cut the rest of the video.
    http://mirror.uplugins.com/get-camera-frame/

    You need to update the video background material with the mask and the background texture of your choice.



    Originally posted by decky.mediapro View Post
    Thank you mr. Hovart for your reply. I was able to solve the problem by fixing my visual studio software, and running well like i did in this image.

    Right now i'm hoping that i can change the background with some images, like the other image, for example. Is it possible? If so, how do i do that? and how to share photo with email ? Can't wait to see your reply.

    Leave a comment:


  • replied
    Thank you mr. Hovart for your reply. I was able to solve the problem by fixing my visual studio software, and running well like i did in this image.

    Right now i'm hoping that i can change the background with some images, like the other image, for example. Is it possible? If so, how do i do that? and how to share photo with email ? Can't wait to see your reply.

    Leave a comment:


  • replied
    Press "1" or "2" to switch between sensors.

    Originally posted by decky.mediapro View Post
    Hi Adam

    I have yesterday purchased the licensed version, i have already compile all material plugin, but when I test only the black screen image comes out, kinect doesn't work. I use kinect v2
    help me please

    Leave a comment:


  • replied
    Hello Decky,

    What is in the logs ? Did you try to rebuild from Visual Studio ? The latest version only compiles for 4.21

    Originally posted by decky.mediapro View Post
    Compiling problem when we tried to rebuild the plugin from epic games launcher on UE 4.21/4.18

    Leave a comment:


  • replied
    Compiling problem when we tried to rebuild the plugin from epic games launcher on UE 4.21/4.18

    Leave a comment:


  • replied
    Hi Adam

    I have yesterday purchased the licensed version, i have already compile all material plugin, but when I test only the black screen image comes out, kinect doesn't work. I use kinect v2
    help me please

    Leave a comment:


  • replied


    Hello, I intend to occupy the "1" key for something, but it already has a linked function. I can not find where you are, could you help me? Thank you

    Leave a comment:


  • replied
    Hello,

    I've made a new demo with UE4.21. Check it out.

    Download link:
    https://drive.google.com/uc?id=1FZpO...xport=download



    Originally posted by kpslook View Post
    Hi!

    We tested it here, but for some reason the demo is crashing... it works for a time, some times it doesn't activate the camera.
    Could you build a new demo at UE 4.20?

    Thanks in advance,

    Leave a comment:


  • replied
    Hi!

    We tested it here, but for some reason the demo is crashing... it works for a time, some times it doesn't activate the camera.
    Could you build a new demo at UE 4.20?

    Thanks in advance,

    Leave a comment:


  • replied
    Hello,

    Please check this tutorial video for importing characters from mixamo to unreal.
    https://www.youtube.com/watch?v=vgo4jnM0NyY



    Originally posted by Adsmnpratik View Post
    AdamHorvath

    Hi Adam,

    I recently brought your plugin for one of my projects which is on priority and is on hold due to an issue. After the FUSE export, UE4 does not recognize the same skeleton structure and it crashes the plugin completely can you please help me with the updated import cloth or some way out of it??. Now is this due to the new update on mixamo as there is no UE4 export option available on it
    or what. The skeleton structure completely changes.

    Please help me with it.

    Thanks,
    Prateek

    Leave a comment:


  • replied
    Hello Everyone.

    I need to know who can replace new cloths to this plugin success?

    Please show me how to do that.

    Thanks!
    Red

    Leave a comment:


  • replied
    AdamHorvath

    Hi Adam,

    I recently brought your plugin for one of my projects which is on priority and is on hold due to an issue. After the FUSE export, UE4 does not recognize the same skeleton structure and it crashes the plugin completely can you please help me with the updated import cloth or some way out of it??. Now is this due to the new update on mixamo as there is no UE4 export option available on it
    or what. The skeleton structure completely changes.

    Please help me with it.

    Thanks,
    Prateek

    Leave a comment:


  • replied
    Hello I'm interested your plugin.

    Before I buy it , I need to know this forum is still support user.

    Thanks
    Red.

    Leave a comment:


  • replied
    Hello,

    Sent you PM with details.

    Originally posted by w200910282 View Post
    I am a user in China. I bought your plugin. On the plugin download page, I downloaded five times, and never completed the whole download process. Can you help solve the problem? All the plug-ins I bought could not be unzip.

    Leave a comment:

Working...
X