UE4 replication system works the same regardless of platform, you just connect to server via IP
The sessions are only for listing server discovery,other wise you need to give server IP. For that you need game online service (Steam etc.), without it server discovery works only in LAN. But for development propercies you can just use IPs.