Minimum specs for the ValleyoftheAncient is a GTX 1080 with atleast 8GB of VRAM, with 32GB memory.
So I reckon that when you want to use Nanite, these are the specs you might need.
Your GPU i think is the bottleneck here, have you tried it without Lumen?