A dedicated server shouldn’t need to log in via Connect. Instead, you want to configure a trusted client in the dev portal and use the Client ID and Secret for that client in the config to initialize the SDK or plugin on the server. The docs explain this in more detail here.
https://dev.epicgames.com/community/learning/knowledge-base/nOR9W/epic-online-services-how-do-i-log-in-on-a-dedicated-server-using-eos