If the Server only had one Character instead of one for each Client + himself, how should the rest of the network game
see his Character? 
Every player has an instance of the Character of the other players. Otherwise they wouldn’t be able to see each other.