Lumen performance vs Raytracing

Did you also enabled Virtual Shadows? Because that kills the performance on my project. Lumen with Shadow Maps works fine performance wise. Virtual Shadows basically cut fps in half and produce a lot of hitches.