Cannot get any online subsystems to work, including default

I am having a frustratingly horrible time trying to get multiplayer working in my project. My initial plan was to get the game into the Steam ecosystem using the Advanced Steam Sessions plugin, but had a terrible time with that so decided to get basic multiplayer host/join functionality in place using the default online subsystems plugin in UE.

Both me and the other developer share an office and internet connection. When we use the Create Session and Find Session nodes, the sessions never show up (both with and without Use LAN enabled). This makes it impossible for either of us to connect to each others session for true multiplayer testing.

If we set our editor to ‘2’ players, we start the game, and one instance hosts the other instance can ‘find and join’ the hosted game, but only from the same machine.

We even tried packaging the build up (in development mode), and still cannot see any created lobbies.

We originally had steam advanced sessions plugin installed, and with that we could both see each others lobbies, but we could not join, and received an error with OnlineSubsystemSteam plugin when trying to package, so we disabled it.

Any help would be greatly appreciated. I truly banging my head as to why none of this is working, even the default subsystem.