A sudden spike on GPU / 100% GPU use

I played the project for 10 minutes and I saw no lags without the shadow maps however my other friends tried it with a RTX 2060, they were getting about 20-30 frames and did experience hitches but never the same lag that I get with RTX 4090. I get smooth frames with my 4090 but all of a sudden after like few minutes my game completely freezes, it freezes so bad that it crashes and gives me an error saying “GPU Crashed or D3D Device Removed”.

I also tried other games such as the new forza and doom eternals on maximum graphics to check whether the problem was from my graphic card, however I didn’t lag in those games.