Hey there @ruski! Welcome to the community! So this can happen sometimes with really heavy lightmaps or massive overdraw. Thread with a somewhat similar issue (but for mobile which always much harder to balance).
How does your insight profiling look?