Does anyone have any idea on how can I implement frame interpolation in unreal engine? I can generate a frame using data from two rendered frames, however I have no idea how can I insert the generated frame in between the rendered frames, can anyone help me regarding this question. Thanks.
Hi @huaw2646
Let’s see…
To implement frame interpolation in Unreal Engine and insert the interpolated frame between the two rendered frames, do the following:
Capture Rendered Frames: Use SceneCapture2D or rendering to texture to capture the two frames that you want to interpolate.
Generate Interpolated Frame: Use motion data (velocity, position, or optical flow) to create the in-between frame based on custom logic or shaders.
Insert Interpolated Frame
Apply a custom post-process effect or render pass to merge the two frames.
Alternatively, use temporal reprojection or Unreal’s temporal AA system to generate smooth interpolations.
You may have to override the frame buffer with Custom Depth, Render Targets, or by altering Unreal’s internal frame rate.
Advanced Techniques: Employ optical flow-based interpolation for improved quality or implement a custom Blueprint/C++ class to control interpolation and inject the in-between frame.
This technique consists of recording frames, creating interpolated frames, and altering the render pipeline to include them in between the original frames.