Just decided to repost my thoughts here, felt I was taking over the thread too much! There’s not enough interesting discussion yet!
VR Workspaces
Would like the ability to place the editor windows in user definable places, for example: 1. on the controller (like it is now) 2. Docked as a HUD in a desired position and size in the users field of view. 3. Docked at desired locations and sizes in the world, so the user could create their own virtual workspace… These three modes seem really interesting, why only use one approach. Also create a very intuitive way to grab the editor screens off the controller and stick it where you want, in the HUD or someplace in the world.
VR Measuring Tools
How about some extra tools such as a measuring tape, protractor, 3D guides and construction planes, for measuring out real world scale and layout. I love how Sketchup works, if you want a doorway 8 ft high and 3.5 ft wide its super easy to measure out with the guides first, then build on top of it. Snapping to construction guides is awesome. Most non-CAD 3D software don’t have good measuring or layout tools. I want to work more like a construction engineer in VR.
VR Voice Command
Voice command of what you are looking or pointing at, would be a good addition to direct manipulation with touch controllers. “Scale 150%”, “New light”, “Add material”, “Scale world 50%”, “Add tree mesh”… Seems like this would reduces the amount of pointing, calling up the browser, or difficulty inputing precise input values.
VR Animation
How about taking possession of a character in VR so you can use your own body to put it in a pose or teach it how to move or perform a complex action. Would of course require additional full body motion capture. I just like the idea of doing it in VR. When you jump inside a body you are animating first person, leave the body and you can refine the animation from a third person point of view. I can imagine onion skinning in VR and also manipulating a 3D spline for path based animation. So many interesting things to explore with VR animation.
VR Cinematics
Directing Matinee/Sequencer cutscenes in VR would be super cool. You first block out your shots, stage props and actors, set up the lighting and perform your own camera work and acting. Then you perform virtual editing and camera cuts. You could loop your sequence and keep adding layer on top of layer. You might manipulate time in similar ways as world scaling, with gestures.
VR Game Logic
I really want the ability to walk around my scene and set up all the game logic in VR. For example. I could add a collision volume in a doorway, and when I walk into it, a floating event alert would appear I would then connect this to a Blueprint handler that I add to the scene. when I touch the 3D blueprint hovering in space, it would suddenly expand into a representation of a blueprint graph with 3D plumbing and layout. There is yet, no programming metaphor in VR space that I’m aware of, but seems like blueprints should work. (I think Epic should sponsor a contest to design and illustrate the best and most exciting way to bring blueprints into VR space)
Destroy Mode
One thing I would love to do, the ‘laser pointers’ often look like lightsabers from star wars as you swing them around. Can they be put into destroy mode, where they become shorter like a sword so you can slash anything you want to delete in the scene? The developers behind Fantastic Contraption implemented a fantastic ‘balloon popping with sharp pin’ mechanic to delete items out of the world. Stuff like swinging your a lightsaber to destroy unwanted content just makes the experience more fun and enjoyable.
Painting Meshes
What about planting meshes like trees or rocks everywhere you point and click to add them. perhaps this gets into world building tools a bit. Would feel better than having to alt drag copies into existence when you have forests to plant.
Multi-Select
What if the tip of your laser pointer could spread out into a cone shape with an adjustable radius so you could select multiple objects at a time and then manipulate them as a group. So the laser pointer becomes more of a flashlight with variable falloff. Maybe the green sphere at the tip becomes a hoop shape surrounding the desired objects. Only objects completely contained in the cone would be selected this would help unwanted meshes from being selected. Also you could center your selection on the furthest object to be selected to help define a distance range for the selection.
Navigational Bookmarks
Would like an easy way to ‘bookmark’ the user’s location/vantage point/world scale to presets, floating markers or voice commands, to jump back and forth from several vantage points while working, so you don’t spend unnecessary time navigating. I found this to be super useful in 3D software like Sketchup, it saves so much time and is also good for creating guided presentations for others that are evaluating your work. There would of course be animated transitions from one vantage point to the next to make it feel natural, like teleporting I suppose.
Building Composite Objects
The ability to construct composite objects, using grouping, parenting, or physical constraints such as pins or pivots.
Physical Sim
There’s probably lots that could be done with physical simulation. designing in VR without some kind of physics or constraints might actually impair good design decisions as well as make the environment feel too magical and not grounded.
Assistive AI
In the future, I would like to see some of the new generation of AI (deep learning) used to assist the user in manipulating the world in logical ways. For example, currently computers don’t recognize when an object is oriented in illogical or impossible configurations, such as a tree standing upside down or growing perpemdicular out of a wall. The AI could assist the user in correcting these problems. AI might one day lower the learning curve for artists by intelligently assisting them in selecting and using tools, balancing compositions or taking over and performing repetitions tasks. This kind of assistive technology is in heavy development today. VR seems like a perfect place to use this new technology.