Announcement

Collapse
No announcement yet.

the goal is to feel you are inside the painting

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

    [TUTORIAL] the goal is to feel you are inside the painting

    I'm looking for the best process to transform a 2D landscape painting into a navigable 3D scenario using UE4 and perhaps also Blender (or any other 3dtool).
    If somebody has any idea to share, you are welcome!

    Here an example of the painting I'd like to convert into a 3D scene, with same texture and colors of courseā€¦.
    the goal is to feel you are inside the painting!

    Click image for larger version

Name:	landscape.jpg
Views:	1
Size:	274.2 KB
ID:	1655750

    #2
    I have started saparating the paint into parts, in order to treat them separately (sky, landscapes and geometry objects).
    From here there are many ways to proceed, recreating each part into UE4 and using the Painted parts as texture materials to apply in the UE4 scene, but still have not clear which can be the best way to proceed in terms of timing and final realism->"feel you are in the painting".


    Click image for larger version  Name:	Painting_decomposition.jpg Views:	1 Size:	296.1 KB ID:	1655768
    Last edited by VerumBit; 08-22-2019, 07:46 AM.

    Comment


      #3
      I went in my past works and retrieved a paint shader effect that could help to give a paint realism effect:
      https://youtu.be/271xI-aR3t8?t=63

      Ideas:
      Perhaps using UE4 geometry to recreate the main objects shapes (house, lighthouse) and recreate the wall texture from the paint image could solve these parts.
      Also the sky could be recreated.

      Open Issues:
      The grass & rocks, the beach and sea and the main tree are still an open issue on how to generate them with same paint textures.
      Also the parts you don't see in the painting need to be recreated in order to have a fully navigable 3d scenario.

      Comment


        #4
        Just found this VR app which inspirate the idea behind. These guys did a huge work. What I'm looking is a more fast process but still realistic...to be used mainly for landscapes paintings, not human paintings.
        Perhaps VR painting is a way to do so but UE4 grass and vegetation is already there, just need to adapt the painting materials to the vegetation.
        Still looking for a effiecient process to follow.

        Last edited by VerumBit; 08-22-2019, 08:56 AM.

        Comment


          #5
          I decided to change painting and approach the 2D->3D convertion with a more geometric painting style.
          Here the painting I'll try to convert from 2D to 3D and port to VR.
          Once converted and recreated into a 3D scenario with same textures and gemoetries, I'll export the project into VR (I have an Oculus Quest) as an executable apk and show it to the real artist painter I personally met few days ago. Oculus Quest is wireless so very easy to take around and let people use it istantly, with no PC.
          I'll record the painter feedbacks (if I have her permission) to understand if I reached my intial goal: 'FEEL INSIDE THE PAINTING'
          Hope to take some good results in a week from now, which will consist in a youtube tutorial on how I did the conversion and the VR immersion video&reaction of the painter who did this very cool painting I personally appreciate!

          Click image for larger version

Name:	boats_in_the_night.jpg
Views:	1
Size:	152.9 KB
ID:	1656229

          Comment


            #6
            Your best bet would be a normal 3D environment with post-processing effects. There's a project you can download from launcher showcasing stylized rendering with some rendering post-processing effects.

            https://youtu.be/DlQauwbS6vY
            | Savior | USQLite | FSM | Object Pool | Sound Occlusion | Property Transfer | Magic Nodes | MORE |

            Comment


              #7
              Its really cool. The effect of a portal door window would probably help you assemble the painting as a level. I think orthographic mode, and then fading into a perspective camera would be pretty awesome effect. As if u were staring at a wall in ortho and blinked then it became perspective. A long time ago i was at a wax museum and they had a orthographic projection box with the eyehole next to a wax action display and when u looked through it was like a photo of the painting.

              Comment


                #8
                Originally posted by BrUnO XaVIeR View Post
                Your best bet would be a normal 3D environment with post-processing effects. There's a project you can download from launcher showcasing stylized rendering with some rendering post-processing effects.

                https://youtu.be/DlQauwbS6vY
                Thanks, will download it!

                Comment


                  #9
                  Originally posted by thadkinsjr View Post
                  Its really cool. The effect of a portal door window would probably help you assemble the painting as a level. I think orthographic mode, and then fading into a perspective camera would be pretty awesome effect. As if u were staring at a wall in ortho and blinked then it became perspective. A long time ago i was at a wax museum and they had a orthographic projection box with the eyehole next to a wax action display and when u looked through it was like a photo of the painting.
                  Nice idea! If I understood, after realized the 3d Convertion you say to create a camera location and angle with an eye hole in front, from which you can look at the 3d scene and see exactly the same image as the 2d painting! Correct?

                  Comment


                    #10
                    Hello! I am in many ways not surprised that I found this forum post. For the last year I have been somewhat pondering this same or similar scenario with an artwork asset myself. The difference is I will be making an actual level not just a virtual or illusion as if you're in the painting. One difference is tthe artifact I am targeting is a large wall mural. This post does give me some insight although I am currently working on acquiring permission to the use of the artwork asset.

                    Comment


                      #11
                      Originally posted by IFamStudios View Post
                      Hello! I am in many ways not surprised that I found this forum post. For the last year I have been somewhat pondering this same or similar scenario with an artwork asset myself. The difference is I will be making an actual level not just a virtual or illusion as if you're in the painting. One difference is tthe artifact I am targeting is a large wall mural. This post does give me some insight although I am currently working on acquiring permission to the use of the artwork asset.
                      Hi, infact I also want to create a full 3d level to navigate inside. The eyehole camera will be just an extra actor to add inside the level. Creating a full 3d level from a 2d painting requires some creativity to fill the entire level with the parts of the painting... That's why I choose a paint made by an artist I met and to whom I will show the final work to understand if I catch the painting original idea! Just to be sure that my extra creativity to create a scenario is aligned with the painter creativity.

                      Comment


                        #12
                        I just found this site wunderparc.com that propose landscape convertion from 2d to 3d via AI. Does someone know it already?

                        Comment


                          #13
                          some stuff in the painting direction:


                          back in 2003, in UEd3: Ammo cartridges right are the original textures, next to the left the painted texture version of it.

                          Attached Files
                          Last edited by Vollgaser; 08-27-2019, 05:50 AM.

                          Comment


                            #14
                            I'll pause this acitvity since I end to the point that 90% of the 3d construction has to be done under Blender (or maya,3dmax,etc) and finally imported into UE4 for VR expereince.
                            Rebuilding the paint and reconstructing it in 3d with Blender is for sure possible, it is for sure a lot of work extending the paint to a bigger 3d scenario but the final conclusion is that all the work done will not be reusable as a procedure for other paintings. That's why a pause it until me or somebody else don't come out with a more structured approach to be applied to any paint 3D creation.

                            Comment

                            Working...
                            X