We are using the new chroma key in composure 5.7 and in general it is much better than the old one, however it seems to have far less controls to fix issues. I do not see any way to fix the edge of the key or erode the alpha channel to remove edge problems. I see you have a FXAA layer pass you can add, but when I enable that I don’t see anything change on my screen, not a single pixel seems to change when I enable or disable that. Is that function working? or is there something else I need to do to enable it?
Here is a snip of our key from a Hitachi Z-HD6000 camera and we have a line around the edge sometimes like you see here in this pic. The really strange thing is that it seems to move around if you move your hand back and forth it is like this black edge around it seems to “lag” behind the video as you move, as if it is a separate key/fill and the alpha is lagging behind.
No, we have spent hours trying to change settings to fix our keying problems. Though it is certainly affected by the anti aliasing pass combined with the background affecting the video. If you turn off AA completely it really changes the edge of the key but ruins the other parts of the scene.
This won’t solve your issues now, but in 5.8, there will be a new pass type to erode/dilate colors around translucent alpha. To be combined with keyer use, for instance. There will also be alpha-only blur support, which can be used in combination.
So we have determined that this not not necessarily a keying problem. This ghosting in the key is caused by the Anti-Aliasing setting in unreal. If i disable AA then the key is perfect and the background looks terrible. If i use temporal TAA or TSR settings the background scene looks perfect but the key has this terrible ghosting around the edges of anything moving.
How can I tell unreal to only apply the TSR to the background and not effect my video layer? Or what is the proper solution to fix this? I have found a couple of settings that seem to apply.
“responsive AA” is something that is supposed to affect this, but composure doesn’t seem to use a normal texture material so i am unable to find this setting.
I feel like the solution might relate to composure doing a 2d texture instead of 3d and using the scene capture layer maybe? However, the documentation does not explain anything about how to do this.
