Seems like I found the issue ! While making some researches, I found this guy answer to an other kind of GPU crash :
I checked out, and it appeared that the SSD on which I’m working had none. So I put everything on auto like him. And everything seems fine so far.
Don’t know why the issue is specific to a couple of maps in the project, but what do you know ?
Maybe this will be helpful to someone ! Cheers