Clients don't sync with server after changing level

When I change the level (I do so with ServerTravel), it seems that clients stop syncing completely.

Clients won’t move or look around, as well as the positions of pawns will not update.