I’m looking for the best process to transform a 2D landscape painting into a navigable 3D scenario using UE4 and perhaps also Blender (or any other 3dtool).
If somebody has any idea to share, you are welcome!
Here an example of the painting I’d like to convert into a 3D scene, with same texture and colors of course….**the goal is to feel you are inside the painting!
**I have started saparating the paint into parts, in order to treat them separately (sky, landscapes and geometry objects).
From here there are many ways to proceed, recreating each part into UE4 and using the Painted parts as texture materials to apply in the UE4 scene, but still have not clear which can be the best way to proceed in terms of timing and final realism->“feel you are in the painting”.
I went in my past works and retrieved a paint shader effect that could help to give a paint realism effect:
Ideas:
Perhaps using UE4 geometry to recreate the main objects shapes (house, lighthouse) and recreate the wall texture from the paint image could solve these parts.
Also the sky could be recreated.
Open Issues:
The grass & rocks, the beach and sea and the main tree are still an open issue on how to generate them with same paint textures.
Also the parts you don’t see in the painting need to be recreated in order to have a fully navigable 3d scenario.
Just found this VR app which inspirate the idea behind. These guys did a huge work. What I’m looking is a more fast process but still realistic…to be used mainly for landscapes paintings, not human paintings.
Perhaps VR painting is a way to do so but UE4 grass and vegetation is already there, just need to adapt the painting materials to the vegetation.
Still looking for a effiecient process to follow.
I decided to change painting and approach the 2D->3D convertion with a more geometric painting style.
Here the painting I’ll try to convert from 2D to 3D and port to VR.
Once converted and recreated into a 3D scenario with same textures and gemoetries, I’ll export the project into VR (I have an Oculus Quest) as an executable apk and show it to the real artist painter I personally met few days ago. Oculus Quest is wireless so very easy to take around and let people use it istantly, with no PC.
I’ll record the painter feedbacks (if I have her permission) to understand if I reached my intial goal: ‘FEEL INSIDE THE PAINTING’
Hope to take some good results in a week from now, which will consist in a youtube tutorial on how I did the conversion and the VR immersion video&reaction of the painter who did this very cool painting I personally appreciate!
Your best bet would be a normal 3D environment with post-processing effects. There’s a project you can download from launcher showcasing stylized rendering with some rendering post-processing effects.
Its really cool. The effect of a portal door window would probably help you assemble the painting as a level. I think orthographic mode, and then fading into a perspective camera would be pretty awesome effect. As if u were staring at a wall in ortho and blinked then it became perspective. A long time ago i was at a wax museum and they had a orthographic projection box with the eyehole next to a wax action display and when u looked through it was like a photo of the painting.
Thanks, will download it!
Nice idea! If I understood, after realized the 3d Convertion you say to create a camera location and angle with an eye hole in front, from which you can look at the 3d scene and see exactly the same image as the 2d painting! Correct?
Hello! I am in many ways not surprised that I found this forum post. For the last year I have been somewhat pondering this same or similar scenario with an artwork asset myself. The difference is I will be making an actual level not just a virtual or illusion as if you’re in the painting. One difference is tthe artifact I am targeting is a large wall mural. This post does give me some insight although I am currently working on acquiring permission to the use of the artwork asset.
Hi, infact I also want to create a full 3d level to navigate inside. The eyehole camera will be just an extra actor to add inside the level. Creating a full 3d level from a 2d painting requires some creativity to fill the entire level with the parts of the painting… That’s why I choose a paint made by an artist I met and to whom I will show the final work to understand if I catch the painting original idea! Just to be sure that my extra creativity to create a scenario is aligned with the painter creativity.
I just found this site wunderparc.com that propose landscape convertion from 2d to 3d via AI. Does someone know it already?
some stuff in the painting direction:
[ATTACH=JSON]{“data-align”:“none”,“data-size”:“full”,“data-tempid”:“temp_171709_1566898592722_486”,“title”:“HighresScreenshot00007-5.jpg”}[/ATTACH]
back in 2003, in UEd3: Ammo cartridges right are the original textures, next to the left the painted texture version of it.
[ATTACH=JSON]{“data-align”:“none”,“data-size”:“full”,“data-tempid”:“temp_171713_1566899349196_425”,“title”:“ammovergleich.jpg”}[/ATTACH]
I’ll pause this acitvity since I end to the point that 90% of the 3d construction has to be done under Blender (or maya,3dmax,etc) and finally imported into UE4 for VR expereince.
Rebuilding the paint and reconstructing it in 3d with Blender is for sure possible, it is for sure a lot of work extending the paint to a bigger 3d scenario but the final conclusion is that all the work done will not be reusable as a procedure for other paintings. That’s why a pause it until me or somebody else don’t come out with a more structured approach to be applied to any paint 3D creation.
