The likely cause of this issue is that your brand settings haven’t been approved. Presence will only show to other players for games with brand settings approved. Be mindful this is applicable to games with native platform integration to show presence on other platforms.
https://dev.epicgames.com/community/learning/knowledge-base/58KmX/epic-online-services-why-is-player-presence-showing-as-online-instead-of-which-game-they-are-playing