Steam overlay doesn't work in Shipping/Editor

Hello.
I am trying to integrate steamworks into UE 5.1.1 project.

I made a BlueprintLibrary node in C++ and linked it to ‘Game Start’ or ‘GameMode’ node ‘BeginPlay’ event, as following this video tutorial(Integrate steam w/o Steam online system plugin):
[https://www.youtube.com/watch?v=SyCeumSqtbM](UE steamworks without Online System)

I could see myself playing ‘spacewar’( or steam app id 480, a testing game ID for steamworks SDK) in steam status running my project, but pressing ‘Shift+Tab’ won’t bring up the overlay, but for some reason the mouse cursor got center/hide upon ‘Shift+Tabbing’, as if overlay was blocked by game screen elements.

The only mode I could toggle the steam overlay successfully is by using ‘standalone’ launch mode in editor, all other editor modes or shipping to windows version won’t let me toggle the overlay.

I noticed the SDK I linked into game is 1.57, but the one shipped with UE 5.1.1 is 1.53, though I dunno if that minor version has any impact on overlay, there were no error or warning in logs at least.

So am I doing something wrong or missing some steps?

Thanks in advance.