Most likely, players are joining your map in private parties or through matchmaker, not in public lobbies.