Announcement

Collapse
No announcement yet.

NexusVR - Connecting the Metaverse

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • NexusVR - Connecting the Metaverse

    Hey everyone!

    For this year's Leap Motion 3D Jam I've teamed up with Mac from the Night Cafe and we're making NexusVR, a multiplayer portaling system so you don't have to leave VR!

    Here is a first pass WIP after hacking away at UMG to work with VR input



    What you're seeing is me, in VR, hitting an arm menu, which pulls up all the VR experiences that I have available, selecting one, tossing it away, selecting another one and attaching it to the portal gateway infront and using a push gesture to step through.

    What happens next? Wait for the next update
    Plugins: TensorFlow - Socket.io Client - ZipUtility - Leap Motion - Hydra - Myo - RealSense - CIM

  • #2
    More WIP!

    This is what happens when you step through...



    A seamless and quick transition with no waiting. With an endless list to choose from, where will you go?

    GuitarVR experience by @zachkinstner

    How about sharing a video or link?


    Same concept, just turn your data into a virtual object and you can pass it to any receiver such as a big screen.
    Plugins: TensorFlow - Socket.io Client - ZipUtility - Leap Motion - Hydra - Myo - RealSense - CIM

    Comment


    • #3
      Thats awesome!
      My work in progress thread: Pixel Art Sidescroller

      Comment


      • #4
        This is exactly the kind of thing I've been waiting for

        Comment


        • #5
          Just submitted the jam entry, sadly multiplayer got cut due to time constraints, but that means you get the single player nexus all to yourself! Some of the sights of the nexus itself:
















          How portaling looks like now




          And you can browse both using the leap motion (which feels awesome btw) and mouse+keyboard. The search bar is a smart search bar and will redirect non-urls to google search results



          If you have a leap motion and an Oculus HMD, grab it at nexusvr.io which redirects to the jam itch page. Just remember to plop all your portals (vr experiences) into the NexusVR/Portals folder and they'll show up in your portal menu!

          Enjoy!
          Plugins: TensorFlow - Socket.io Client - ZipUtility - Leap Motion - Hydra - Myo - RealSense - CIM

          Comment


          • #6
            Very impressive stuff! Keep up the great work.

            Comment


            • #7
              How did you hack UMG widget to appropriately display VR content? I had a questions here:
              https://answers.unrealengine.com/que...t-vr-mode.html

              Comment


              • #8
                Originally posted by KidBroker View Post
                How did you hack UMG widget to appropriately display VR content? I had a questions here:
                https://answers.unrealengine.com/que...t-vr-mode.html
                I answered your question and I'll elaborate a bit more here:

                For VR you shouldn't use screen based widgets, instead they should be 3d widgets placed and sized in the world. That way they aren't anchored to your face and you can lean in to see more details. It will also sidestep the need to fix screenspace support for VR. See https://docs.unrealengine.com/latest...ets/index.html for details. This step requires no hacks.

                The UMG hacks I've referred to above are about converting your hand collision with your 3d widget to expected responses in UMG. The end result is a surface about 50cm away from you that you can just touch as it if was a physical touchsensitive surface. This means you can do the things you usually expect of modern tablets such as momentum scrolling and tapping to select. With VR though you can also pass your hand through the screen which you can't do in the real world, which allows depth based interaction. In my case I use this to convert what you're looking at into a data cube link you can throw at other screens.

                There are a lot of interesting directions to take this. Given people's interest in the widget stuff, I'll look into maybe packaging up some blueprints and make a video about it?
                Plugins: TensorFlow - Socket.io Client - ZipUtility - Leap Motion - Hydra - Myo - RealSense - CIM

                Comment


                • #9
                  Awsomeness !

                  here are a lot of interesting directions to take this. Given people's interest in the widget stuff, I'll look into maybe packaging up some blueprints and make a video about it?
                  Hell yeah Getnamo. No question about it.

                  learn so much from all the stuff you give to the community.
                  Thank you,

                  behram

                  Comment


                  • #10
                    Very impressive! VR devices have incredible potentials!

                    Comment


                    • #11
                      :O

                      Wow! Great stuff man! Looking forward to seeing a repository with this functionality up on GitHub sometime maybe?

                      Comment


                      • #12
                        Awesome stuff, keep it up
                        Anything the mind of man can conceive and believe, it can be achieved. Napoleon Hill

                        Comment


                        • #13
                          Hi, looks good.

                          I've tried to run NexusVR but it works not so good as your video.
                          Hands are very often not recognised(hidden) or recognised in not best way.
                          How did you do it?

                          Comment


                          • #14
                            Originally posted by zumer View Post
                            Hi, looks good.

                            I've tried to run NexusVR but it works not so good as your video.
                            Hands are very often not recognised(hidden) or recognised in not best way.
                            How did you do it?
                            Make sure you have gone through the basic troubleshooting for leap motion (no bright infrared sources in your FOV, push back slightly to minimize clutter in FOV).

                            Other than that, I think I have a hand count bug in the nexusvr branch of the leap plugin which may cause it to not always detect your hand in FOV, but if you don't see your hand, just bring it out of view and back in to make it detected. Let me know if that helps

                            The next focus is to squash bugs and getting multiplayer support in.
                            Plugins: TensorFlow - Socket.io Client - ZipUtility - Leap Motion - Hydra - Myo - RealSense - CIM

                            Comment


                            • #15
                              Thanks,
                              will try to find solution.

                              It looks like leap device is working fine from start.
                              But then it starts to lag, maybe it overheated or something like this.

                              In any case you've done great work.
                              We have a lot of fun when trying to throw portals.

                              Comment

                              Working...
                              X