Download

Integrate face filter into UE4

We have a face filter written in python/pytorch, which makes the face good-looking. It’s just like
many other filters in the selfie app.
May we know how to apply this filter to the characters in UE4 (generated by metahuman)?
Since this face filter is a 2D filter originally, it’s OK that, this filter only works in the camera ahead of the center of the face.
Any clues or suggestion? Thanks in advance.

You’d have to convert it to a post process.

While there is a python implementation that let’s you do python things, I do not think that’s applicable here.

You’d have to analyze what the filter does and convert it either to HLSL with custom nodes, or directly into the post process material with nodes.
Not the easiest of things.

@tonykcn You may want to consider scene capturing of MetaHuman character so you will have Texture2D to operate on (i.e. pixels). After that you simply apply your python code (or similar c++ code) to texture raw pixels and see whether the result is what you want.
Is that what you need?