Update: It seems like I am an idiot and misdiagnosed the issue. So, the materials seem to get destroyed as they get marked for GC in SetMaterial function. Creating new instances in before assigning them seemed to fix the issue but it looks like a huge performance killer, so I guess I need to figure out a way to prevent the material instance from being destroyed? I am not 100% sure this is the solution but stuff did not seem to crash with the constant instance creation. Given that I am dealing with rendering and two threads interacting, maybe I just got lucky with avoiding the crashes.
1 Like