A couple of things here:
- Instead of using EAutomationTestFlags::ApplicationContextMask, you should be combining the specific flags you want (eg. EAutomationTestFlags::EditorContext | EAutomationTestFlags::ClientContext). Using the mask is discouraged.
- You probably don’t want to be using the SmokeFilter. Tests flagged with SmokeFilter are always run on startup in non-Shipping builds, automatically fail if they take longer than 1-2 seconds, and are hidden by default in the Automation Frontend. This may also explain why your test isn’t showing up; check to see whether the test filter dropdown is set to show Smoke tests.
- The OutTestCommands may be expecting the strings to be either empty strings or key/value pairs formatted like “Key=Value”. I’m not 100% sure on the k/v-pair thing, but that’s how our internal complex tests that use commands are structured.