Additional note:
I’m not sure about the cause, but after changing the maximum player count in Island Settings to something other than 2, and then returning it back, the issue was fixed once I published it.
However, I don’t think this is a fundamental solution, so I would appreciate it if we could find out the root cause.