Ok, so I´ve troubleshooted this some more and was able to find a workaround for now.
I had to disable “support hardware raytracing” and then I could uncheck “Use compute skin cache”, which solved the crashes for me.
Not happy with this, so if anyone finds a better solution or this IS a bug, I´d be happy to hear!