This is a bug that will be fixed in UE5.4. You can backport the change below to UE5.3. https://github.com/EpicGames/UnrealEngine/commit/f86e6e04df0b9f642f2396ba727f154631d7ccb0
https://dev.epicgames.com/community/learning/knowledge-base/JdvMe/epic-online-services-why-is-the-eos-overlay-not-showing-in-standalone-game-or-shipping-builds