Announcement

Collapse
No announcement yet.

4.20 Virtual Camera Project and Plugin

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

    4.20 Virtual Camera Project and Plugin

    I've been experimenting with the Virtual Camera project and plugin shipped with 4.20, and figured it might be helpful for those of us working with it to have a central location for sharing information about how it works. Documentation for the Virtual Camera plugin lives here.

    Here's what I've discovered so far:
    • The easiest way to test it that I've found so far is to install Unremote2 on an ARKit-capable iPad, and connect it to the IP address of the PC running the VirtualCameraSample scene. Works pretty well, but is sensitive to network latency.
      • If your performance is poor, check the following:
        • Is your play-in-editor window set to the same resolution as your iPad? Performance will suffer if it's having to scale dynamically.
        • Are you facing a blank wall? ARKit relies on visible geometry to track movements reliably. If you're using it in a room with blank walls, adding markers to the walls can help.
    • Virtual Camera assets and code live in the Virtual Camera plugin. To view these assets, enable Show Engine Content and Show Plugin Content in your content browser's view options.
    • It seems generally to be a good idea to lock rotation on your iPad when using the virtual camera.
    UIClick image for larger version  Name:	VirtualCameraUI.JPG Views:	1 Size:	217.7 KB ID:	1512104
    • UI Elements, Top Row:
      • Hide/Show UI
        • Click image for larger version  Name:	VirtualCamer_ShowUI.JPG Views:	1 Size:	1.0 KB ID:	1512114
        • You can set user options to determine which elements remain displayed when UI is turned off.
      • Focus mode: Manual, Target, Automatic
        • Click image for larger version  Name:	VirtualCamera_FocusMode.JPG Views:	1 Size:	2.3 KB ID:	1512115
        • Be aware that targeted focusing only works while the focus UI is displayed.
        • When using Manual focus, you can dial in a desired focus distance or tap an object in scene to set focus distance.
        • To set a focus target, have the focus UI displayed and tap the target object to set it as the tracked focus object.
        • When using auto-focus, you can move the focus reticle to set your desired focus point.
      • Options
        • Click image for larger version  Name:	VirtualCamera_OptionsButton.JPG Views:	1 Size:	1.3 KB ID:	1512116
        • General Settings
          • Click image for larger version  Name:	VirtualCamera_GeneralSettings.JPG Views:	1 Size:	25.8 KB ID:	1512105
          • Input Source
            • ARKit uses the iPad Pro's ARKit implementation to track the camera position.
            • Vive tracking requires the Steam Controller plugin and Steam VR plugins to be enabled.
          • Playback
          • Global Boom
            • Not yet clear what this describes.
        • Film Format / Aspect Ratio
          • Click image for larger version  Name:	VirtualCamera_FilmFormat.JPG Views:	1 Size:	27.7 KB ID:	1512106
          • Film Format
            • Update the CineCamera Component of the Virtual Camera Pawn to add new camera types.
          • Matte
          • Matte Opacity
        • Focus
          • Click image for larger version  Name:	VirtualCamera_Focus.JPG Views:	1 Size:	31.3 KB ID:	1512107
          • Focus Method
            • Identical to the MTA buttons on the main UI.
          • Focus Distance
          • Focus Visualization
        • Stabilization
          • Click image for larger version  Name:	VirtualCamera_Stabilization.JPG Views:	1 Size:	28.0 KB ID:	1512108
          • Stabilize Movement
          • Stabilize Rotation
        • Axis Locking
          • Click image for larger version  Name:	VirtualCamera_AxisLocking.JPG Views:	1 Size:	35.1 KB ID:	1512109
          • Truck
          • Dolly
          • Boom
          • Tilt
          • Pan
          • Dutch
        • Motion Scale
          • Click image for larger version  Name:	VirtualCamera_MotionScale.JPG Views:	1 Size:	35.5 KB ID:	1512110
          • Truck
          • Dolly
            • Truck and Dolly can be locked in sync with each other using the link button between them.
          • Boom
        • View Freeze
          • Click image for larger version  Name:	VirtualCamera_ViewFreeze.JPG Views:	1 Size:	32.6 KB ID:	1512111
          • Allows you to freeze the view to move to a new physical location for easier tracking.
        • Visibility
          • Click image for larger version  Name:	VirtualCamera_Visibility.JPG Views:	1 Size:	33.3 KB ID:	1512112
        • Presets
          • Click image for larger version  Name:	VirtualCamera_Presets.JPG Views:	1 Size:	31.9 KB ID:	1512113


    .
    Last edited by KevODoom; 08-13-2018, 06:18 PM.

    #2
    • UI, Middle Row
      • Focal Length
        • Click image for larger version

Name:	VirtualCamera_FocalLength.JPG
Views:	1
Size:	10.2 KB
ID:	1512121
      • Focus Distance and Lens Aperture
        • Click image for larger version

Name:	VirtualCamera_FocusAndAperture.JPG
Views:	1
Size:	12.7 KB
ID:	1512122

    Comment


      #3
      • UI, Bottom Row
        • Record
          • Click image for larger version  Name:	VirtualCamera_RecordMenu.JPG Views:	1 Size:	6.1 KB ID:	1512130
          • Screenshot Menu
            • Allows user to manage screenshots
          • Screenshot Button
            • Takes a screenshot
          • Main Record Button
            • Starts and stops a camera movement recording
        • Joystick Docking
          • Click image for larger version  Name:	VirtualCamera_Docking.JPG Views:	2 Size:	1.7 KB ID:	1512132
          • If your virtual joysticks aren't working, ensure that you've set bAlwaysShowTouchInterface=True in your DefaultInput.ini
        • Performances
          • Click image for larger version  Name:	VirtualCamera_Performances.JPG Views:	1 Size:	7.6 KB ID:	1512133
          • Allows selection of existing recorded or generated Sequences in the scene for playback
        • Waypoints
          • Click image for larger version  Name:	VirtualCamera_Waypoints.JPG Views:	1 Size:	5.8 KB ID:	1512134
          • Waypoints Menu
            • Displays a list of saved waypoints
          • Home
            • Teleports the view to the home waypoint
          • Main Waypoint
            • Saves the current view location as a waypoint
      Attached Files
      Last edited by KevODoom; 08-10-2018, 10:44 PM.

      Comment


        #4
        i tired using the example project with my ipad 12.9in
        at first it was working with rotation
        but after following the https://docs.unrealengine.com/en-us/...alCameraPlugin
        instructions I can't get UE4 to react to the ipad
        any thoughts?

        Comment


          #5
          Originally posted by YuuJin View Post
          i tired using the example project with my ipad 12.9in
          at first it was working with rotation
          but after following the https://docs.unrealengine.com/en-us/...alCameraPlugin
          instructions I can't get UE4 to react to the ipad
          any thoughts?
          This happened to me as well.

          Commenting out this block in DefaultEngine.ini restored movement:

          [RemoteSession]
          +Channels=(Name=FRemoteSessionFrameBufferChannel,Mode=Write)
          +Channels=(Name=FRemoteSessionInputChannel,Mode=Read)
          +Channels=(Name=FRemoteSessionARCameraChannel,Mode=Read)
          +Channels=(Name=FRemoteSessionXRTrackingChannel,Mode=Read)

          Camera rotation did work briefly with these RemoteSession channels set up, but then failed on a subsequent run and couldn't be used again without commenting the block out.
          Anybody else have thoughts on this?

          Comment


            #6
            I to had this problem. Removed it and now have movement back through the ARKit function. Weirdly however my vive tracker know longer works through the IPad. It works fine through the PIE window but as sson as I connect via the remote app the camera changes. Any ideas on this? or how its integration works. I wonder if when the remote connection is made its pulling a different Tracker ID
            Last edited by JTilla; 08-19-2018, 11:20 AM.

            Comment

            Working...
            X