Weird shadow artifacts with Lumen

There is, they made use of a method like that in Valley Of The Ancients to avoid accumulation issues when swapping worlds, but I don’t remember what it was- I would suggest you check out their method for inspiration?