I managed to make it work by using the commands in this post Launching automation test outside of the editor (on a packaged build) - Programming & Scripting / C++ - Epic Developer Community Forums
However, it only works if I package the project from the editor and I leave the default package folder name as “Windows”. If I package with the project launcher it doesnt work.
Any advice ?