bPresenceEnabled must be set to true in EOS_Lobby_CreateLobbyOptions or EOS_Sessions_CreateSessionModificationOptions for the overlay to know of the lobby/session. This error in the logs in indicative of this issue. or
https://dev.epicgames.com/community/learning/knowledge-base/oraRv/epic-online-services-why-is-the-invite-button-not-showing-up-in-the-overlay