I haven’t tried using P2P sockets and the NetDriverEOS with a dedicated server myself, but I think the issue is somewhere in that area.
We are currently using EOS as the native platform service, i.e.
[OnlineSubsystem]
NativePlatformService=EOS
Have you tried using the default net driver and turning off the P2P sockets?