Hey ,
There’s a currently unresolved known issue with 4.10.1 and beyond (UE-24894) in which packaged games cannot find sessions on same machine. Are you attempting to connect to instances of game on same machine? When you say with or without Steam, are you referring to running Steam Client, or using Steam OSS in project’s DefaultEngine.ini?