UE-XM - OpenXR VR UI Interaction System (Hand Tracking & Controllers)

Please watch this video before purchasing:
OpenXR_UI Project Prerequisites Description
Demo(演示项目) :
Playable Demo 打包Demo百度云

Video(演示视频):
YouTube Trailer

Documentation(文档):
Documentation_PDF

Gemini Document Tool
Tutorials(教程):

Only Available in Chinese for Now
Bilibili Chinese Tutorial Video
Overview

This is a VR 3D UI collision interaction solution based on Unreal Engine 5 + OpenXR.
The core goal is to ensure hand interaction with 3D UI without penetration, while supporting both controller and hand gesture input.

The system is implemented in a component-based architecture, allowing quick configuration and easy reuse across different projects.

Main features include:

  • 3D UI widget interaction with collision blocking

  • UI displayed when looking at the palm

  • Pressable 3D UI buttons

  • Replaceable hand gesture models

  • Supports UE5.3 – UE5.7

  • Tested platforms: Quest / Pico / Windows / Android

Detailed FeaturesHand and 3D UI Collision Interaction

  • Collision blocking between hands and 3D UI panels

  • Click triggered when the index finger touches the UI

  • Supports instant feedback during UI press

Two-Hand UI Interaction

  • Supports simultaneous UI interaction with both hands

UI Scrolling and Interaction Direction Control

  • Supports ScrollBox interaction

  • UI can be restricted to respond only from the front side, preventing back-side interaction

UI Snapping and Interaction Distance

  • Customizable UI edge snapping distance

Hand Gesture Model System

  • Hand gesture models are replaceable

  • Default supported models:

    • UE5 VR Template Hands

    • Quest hand gesture models

    • Pico hand gesture models

  • Supports replacement with third-party hand models

Use Cases

  • UI panels and screen-based UI in VR scenes

  • Close-range 3D UI finger touch interaction

Notes

  • This project is implemented entirely with Blueprint logic and can be used without relying on example scenes.

  • Due to changes in Unreal Engine VR template versions, some template content and nodes have been deprecated.

    • If issues occur in newer versions, the documentation provides detailed instructions on how to fix or reconfigure the character.

  • Third-party hand models shown in preview images or videos are not included in the project.

    • Preview content is for demonstrating system compatibility only.

  • When replacing hand gesture models, the skeleton should be as close as possible to the OpenXR hand skeleton structure.

  • The Quest 3 color passthrough effect shown in promotional images is for demonstration only

    • This effect is not included in the project.

  • The project is based on OpenXR.

    • On Windows, MetaXR / PICO OpenXR SDK is not required.

    • When packaging for Android standalone devices:

      • UE5.6 and earlier versions require enabling the MetaXR / PICO OpenXR SDK plugins

      • UE5.6 and later versions (Quest) do not require MetaXR, and no issues have been observed so far