Run automated testing from command line

Yes, in case of failure I do get a error log.
I will also make a script to parse the index.json report