[VR] Need guidance for object selection and UI menu system - Complete beginner

Development Programming & Scripting
, ,
1

Engine Version: Unreal Engine 5.5.4
Platform: VR (Meta Quest 3)
Experience Level: Complete beginner

Hi everyone,

I’m starting a new VR project and need guidance on implementing a specific interaction system. I’m completely new to Unreal Engine, so I’m looking for tutorials, guides, or step-by-step instructions.

What I want to achieve:

  1. Object Selection with VR Controllers: Use pointer/ray casting from VR controllers to select specific objects in the scene

  2. Context Menu Activation: When an object is selected, display a UI menu by pressing:

    • B button (right controller)

    • Y button (left controller)

  3. Spatial UI Menu: The menu should appear near/attached to the selected object in 3D space

  4. 2D Content Display: The menu needs to show:

    • Images

    • 2D charts/graphs

What I’m looking for:

  • Tutorials covering VR object interaction and selection

  • Guides on creating world-space UI menus in VR

  • Best practices for displaying 2D content (images/charts) in VR interfaces

  • Blueprint examples or step-by-step workflows

Specific questions:

  1. What’s the best approach for VR object selection - Line Trace, Widget Interaction Component, or something else?

  2. How do I create UI that appears in world space rather than as an overlay?

  3. What’s the recommended way to display 2D graphs and images within VR menus?

  4. Are there any VR UI frameworks or plugins that could help with this?

Any help, links to documentation, or pointers to existing tutorials would be greatly appreciated!

Thanks in advance!

2

I would suggest to take a look at the VR template to see how widgets and interactions are implemented there. For the Quest you should use the plugins and SDKs provided by Meta.Meta also provide a lot of example projects on Github and ‘code walktroughs’ on their web page.