We recommend leaving the EOS SDK timeout the P2P pending connection. We don’t recommend timing out the pending connection from game code.
https://dev.epicgames.com/community/learning/knowledge-base/PW7EL/epic-online-services-what-is-the-recommend-timeout-setting-for-p2p-pending-connections