Crazy crash happening in 5.3: "LogRHI: Error: Breadcrumbs 'RHIThread'"

The delay in the crash could point towards a variable being garbage collected leading to a null pointer on the server. Are all of your important variables marked with the UPROPERTY macro?

Dedicated server doesn’t really run graphics either. It uses a simplified server model.