So after checking it turns out that the Index of the player is only relevant when multiple controllers are used on the same machine, not for a server-client setup. The Index is going to be 0 for everyone in that case…
Still, what I want is to have different meshes or even materials for the server and for the client.