The plugin doesn’t currently have the EOS SDK code for this. You will need to add EOS_Auth_VerifyIdToken and add code to pass the token retrieved from EOS_Auth_CopyIdToken on the client to the server.
https://dev.epicgames.com/community/learning/knowledge-base/Re1rR/epic-online-services-can-you-use-the-eos-oss-for-user-token-auth-on-dedicated-server