This is a known issue and will be fixed in UE5.4. You can workaround it by: Setting bEnableEditorOverlay to true. Note that the overlay doesn’t currently work in editor builds. This workaround will make it work in-game builds. If modifying the OSS code is an option, you can modify the if statement…
https://dev.epicgames.com/community/learning/knowledge-base/orake/epic-online-services-why-does-the-overlay-only-work-in-game-builds-if-i-have-benableeditoroverlay-set-to-true