Run automated testing from command line

When I run with -Execcmds="Automation Run FCompileBlueprintsTest" I get

ERROR: Failed to find test FCompileBlueprintsTest

I have double checked the name of the test (copied and pasted from a list command). The only way I can get it to work is by specifying a specific BP. We are using UE4.4.