A colleague and I tried to reproduce your issue, but we were both able to delete the Island Settings device and add it back in without causing issues when we went to playtest the project.
Try opening your project and deleting the Island Setting device again. Then add another Island Settings device and see if it works. If you still have problems, we can use your Output Log to see what’s happening.