I got more info. Players get no visual audio at all when they join a game that has already started with players in it. Only if the other player(s) die and respawn they can hear their visual audio.
See video