I looooooooooked and looooooked but could not find a way to change this :0 I even was able to finally change the the WorldGrid material with version 4.20.2 without the editor crashing but it did not change the thumbnail background.
It looks like it is currently not possible.