I found it while digging really deep into the UE workings :
You need to put it in :
GameName/Saved/StagedBuilds/WindowsNoEditor/GameName/Binaries/Win64/
where GameName is the name of your game.
Hoping this will help other people in the future, not being able to launch in editor kinda sucks even though it’s not used much.