The crash occurs during the Shader group of tests.
Steps to Reproduce
- Download the latest Editor from the launcher 5.7.3
- Create a new, blank, C++ project
- Open Session Frontend > Automation
- Run “Standard Tests” (This should exclude expected failing tests)
Expected: All tests are green
Results: There are many errors and warnings as well as an editor crash. For example: CoreUObject DynamicSubobjectInstancing fails with error.
What is the expected state of these automation tests? I would expect that the launder editor build would have all passing tests but this does not seem to be the case. Is there some special configuration that is expected? Are these tests to be considered unstable?
Is there a recommendation on a stable set of tests to use as a baseline if we plan to edit engine source?
Hi there,
I’ve tried running these standard tests in 5.7, 5.6 & 5.5 and the results are more or less the same with many warnings and errors. These are likely due to the tests simply becoming outdated. They do get addressed from time to time. e.g The Dynamic Subobject Instancing test will be fixed in 5.8.
However the test causing crashes are a more significant issue. I found that both of these tests hit and exception and crash the editor:
- System->Physics->Interface->BodyInstance
- Shaders->ShaderPreprocessor->BuiltinMacros
I have submitted a bug report for these. If you are interested you will be able to track the issue here once it is publicly available.
I’m afraid I do not have a recommended set of tests for a baseline. You could create and save a preset of tests that do currently pass in the base version of the engine & only test those against your modified version.
Cheers,
Louis