Ray tracing gpu consumption very high on start up

My game is very bare bones at the moment, currently just animating and getting the animations working. The map is extremely basic, just a few planes here and there. Most of the time when I hit play to test the game, I get extremely poor fps (1-3) at the start of the game due to Ray Tracing Reflections. It takes somewhere between 2 and 60 seconds for the ray tracing reflections to drop down to normal levels (60+ fps). Sometimes it doesn’t have any problems on start up and plays on normal fps the entire time. On rare occasion, the process becomes so cpu intensive that it freezes my computer to the point that control alt delete is unresponsive. Is anyone familiar with why this happens?