Announcement

Collapse
No announcement yet.

Augmented Reality Virtual Mirror plugin for UE4

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • Augmented Reality Virtual Mirror plugin for UE4

    Get the plugin from the following link: http:/mirror.uplugins.com
    Updated DEMO link: https://docs.google.com/uc?id=0BwYpr...GlMZjZvSlZXS00




    Hi everyone,

    I'd like to introduce my second Augmented Reality project for Unreal Engine 4, a full featured virtual dressing mirror.

    Key features:

    - Accurate avateering
    - Automatic fitting, based on joint positions
    - Easy import pipeline from Adobe FUSE (this demo is using clothing from Adobe FUSE)
    - Customizable gesture controlled user interface built with UMG and blueprints.
    - APEX clothing simulation
    - Try on multiple clothes at the same time
    - 3D hand occlusion / 3D masking (experimental, check out the end of the video!)
    - Image based lighting
    - Photo booth functions with social media sharing (currently Facebook sharing to a predefined page is supported)
    - White label solution

    Supported motion sensors:

    I've made custom C++ integrations (with exposed blueprint functionality) for all type of sensors listed below

    - Microsoft Kinect for XBOX ONE - Kinect V2.0 (MS Kinect V2.0 SDK)
    - Asus XTION Pro (OpenNI2/NITE2)
    - Kinect v1.0 (OpenNI2/NITE2)
    - PrimeSense Carmine (OpenNI2/NITE2)

    It will be a great starting point for any virtual dressing / virtual mirror project.
    I am expecting to release it as a plugin very soon!

    This is a WIP video inside UE4 editor on Windows:

    Last edited by AdamHorvath; 03-23-2018, 06:20 AM.

  • replied
    Hello,

    Can you please send me your FBX file ? I'd like to try it, and help you to make it work. Please mail to info@uplugins.com. It's late night here, but I'll check it tomorrow morning.

    Leave a comment:


  • replied
    Originally posted by AdamHorvath View Post
    First of all you need to export male / female avatars from the content folder (MaleFitA, FemaleFitA) as FBX, and design your new clothing for one of them.
    After the clothing is ready, you need to copy the "skinning data" from the avatar to the new cloth, and save as an FBX.

    So you did the right way!

    I am not expert in Maya, but could be an export setting, or unit mismatch. Also you should import your clothing FBX using the original Avatar skeleton.

    Can you see your clothes in the content explorer / mesh / skeleton view ? Does the rig work ?



    Hey!

    I don't think it's a Unit mismatch since the model/avatar sizes are equal inside Unreal, so I guess we can tick that option off;

    They appear to be working fine in the Context Explorer/Mesh/Skeleton View, I believe the rig works since it didn't show me any error when I imported.

    I attached screenshot of the MainUI Blueprint so you can see if I did any mistake on putting it there.

    Thanks in advance for your help!

    Attached Files

    Leave a comment:


  • replied
    First of all you need to export male / female avatars from the content folder (MaleFitA, FemaleFitA) as FBX, and design your new clothing for one of them.
    After the clothing is ready, you need to copy the "skinning data" from the avatar to the new cloth, and save as an FBX.

    So you did the right way!

    I am not expert in Maya, but could be an export setting, or unit mismatch. Also you should import your clothing FBX using the original Avatar skeleton.

    Can you see your clothes in the content explorer / mesh / skeleton view ? Does the rig work ?



    Originally posted by Portine View Post

    Hey, I managed to build the project and make it work on Kinect and stuff, but now I'm having trouble importing my Meshes into the project and the guides seem a little bit outdated due to Mixamo and Fuse. I already had my meshes way before and made them on Maya, what should I do to implement it fully into the game? I exported the Skeleton Model available in the Sample Project and Skinwrapped my clothing to it (at least I believe I did it right), but the mesh won't show up after I implement it inside MainUI Blueprint, what should I do?

    Leave a comment:


  • replied
    Originally posted by AdamHorvath View Post
    Hello,

    Seems like the plugin DLL is not loaded / or compiled properly. Which version of the plugin / engine are you using ?


    Hey, I managed to build the project and make it work on Kinect and stuff, but now I'm having trouble importing my Meshes into the project and the guides seem a little bit outdated due to Mixamo and Fuse. I already had my meshes way before and made them on Maya, what should I do to implement it fully into the game? I exported the Skeleton Model available in the Sample Project and Skinwrapped my clothing to it (at least I believe I did it right), but the mesh won't show up after I implement it inside MainUI Blueprint, what should I do?

    Leave a comment:


  • replied
    Hello,

    Seems like the plugin DLL is not loaded / or compiled properly. Which version of the plugin / engine are you using ?

    Originally posted by Portine View Post
    Hey Adam, I just bought and installed your plug-in and am having some trouble trying to implement it in an empty Project, it keeps sending me Blueprint Compile errors, what should I do?

    Leave a comment:


  • replied
    Hey Adam, I just bought and installed your plug-in and am having some trouble trying to implement it in an empty Project, it keeps sending me Blueprint Compile errors, what should I do?

    Leave a comment:


  • replied
    Hello, Adam.
    I am trying to buy plug-in, but all orders are cancelled (screenshot is attached).
    Probably this is problem with paypal, because paypal do not pay without creating paypal accaunt, after I create paypal accaunt and download all documents, there was a message - "we will contact with you during 30 working days".

    How can I pay for plug-in another way (without paypal)?
    Kind regards.
    Andrei.
    Attached Files

    Leave a comment:


  • replied
    Just updated to Unreal Engine version 4.22

    Originally posted by Armin_Nuvo View Post


    What are the things that were added to the latest version?

    Leave a comment:


  • replied
    Originally posted by AdamHorvath View Post
    Hi everyone,

    I am pleased to announce the latest version of the plugin updated for Unreal Engine v4.22 !

    Available on http://mirror.uplugins.com

    What are the things that were added to the latest version?

    Leave a comment:


  • replied
    Hi everyone,

    I am pleased to announce the latest version of the plugin updated for Unreal Engine v4.22 !

    Available on http://mirror.uplugins.com

    Leave a comment:


  • replied
    You can use and import any standard .FBX skeletal mesh.

    Leave a comment:


  • replied
    Hi, What is the file extension for clothes created?

    Leave a comment:


  • replied
    Hi Adam

    As I can import my clothes correctly, it marks me wrong with the bones.
    Use your solution to pass it to 3ds Max but it does not work, it keeps marking error.

    Help pls....

    Leave a comment:


  • replied
    Hello,

    Let me try to reproduce the problem and get back to you with the solution.

    Originally posted by VaG093 View Post
    Hello Adam!
    First of all - thanks for the good plugin. But I have a problem. On version 4.21, sometimes when i entering to the AvatarMale folder, the engine crashes and the project does not start anymore. I can only create an empty project again.
    I think the problem in Animation Blueprint in this folder. Can do something about it? Maybe you give me a plugin for version 4.20? Is he stable?

    My order ls: #1823 (2019-02-18)

    Leave a comment:

Working...
X