First I want to say, Loving UE5. Great job on it and keep up the great work you all do
In this first photo Nanate is Disabled on the asset level and Shadow Two Sided is check on in the details panel and the shadowing works as expected in casting a shadow when there is no back face.
In this second photo Nanate is Enable on the asset level and Shadow Two Sided is on in the details panel and the shadowing is not working as expected. The light is passing through the object.