Movie Render Queue - Stencil Layer Buffer on Semiopaque / Particles

Hi guys here from WWFX. We are starting to integrate UE4 inside our VFX pipeline.
After some RnD we brought up following questions/issues:

  • We have an issue using stencil layer rendering semiopaque elements, such volumes/fogs on cards or particles for rain/snow etch. It seams on every stenciled leyer output we have, on the output EXRs, we will always see particles or semiopaque layers baked in, so for example let’s say I have a rain or snow and a CG model, I can separate the rain in a single layer with the correct stencil of the model, but on the “model layer” I still will find the partile rain/snow baked in/drawn.

  • Another thing is the alpha edge when rendering using layer buffer, it seams the edge of the elements, they do not combine 100% even plussing the various layer, this affect the RGB beauty pass as well.

  • Last question: Do you know if at this stage, there is a way to render only certain lights on specific stencil layers?

P.S. Following the above tutorial, I think the correct merge node mode between layers, should be DISJOINT-OVER and not PLUS, as only the alpha should accumulate and not the RGB channels. It doesn’s maybe make much difference on solid elements, but it may do on semiopaque elements when rebuilding the image

Thank you in advance.

Hi Lettitude, did you ever find a solution to this? I’m having the same issue using movie render queue in UE5. When I create a simple stencil layer the render will add anything else in the scene that’s using transparency. E.G. in this image I have only one object in the stencil (the ship) but the exr multichannel is including all of the particles and card smokes too.

Can’t use cryptomatte as it doesn’t appear to work with transparency. Anyone have any suggestions? Thanks so much!

Dean.

Hey Dean, did you ever solve this?
I’ve got the exact same problem…

Hey, no nothing yet unfortunately : (

Hey,
I just started looking into this and so far I found in the documents that this is how stencil layers behave (unless I am misinterpreting your cases).

Search for stencil and you will find the section relevant to the issue