Hi,
I'm currently investigating ways to improve the output of the TF-A Tests. This email serves as a proposal. Feedback is welcome.
Attached are 2 text files:
- old-output.txt Shows an extract of how the UART output looks like today.
- new-output.txt Shows an extract of how I propose we present this information in the future.
With this, I hope to improve:
1) Conciseness.
- Duplicated test results are removed.
Tests results are reported as we go along, like they are today but in a more concise way. The final summary no longer repeats individual tests results but instead indicates the success or failure of the entire test suite. (A test suite is marked as passed if all of its tests have either passed or have been skipped.) as well as the total number of skipped/passed/... tests (see at line 57).
- The unnecessary CPU ID headers are removed.
Most of the lines no longer indicate which CPU printed them. This will always be the primary CPU so this information seems useless.
Messages printed by tests continue to print the CPU ID as before. However, instead of printing the CPU MPIDR (e.g. [CPU 0x0001]), the CPU linear index (as returned by the platform_get_core_pos() function) is displayed. It is shorter, while providing the same information.
Messages printed by tests are prefixed by T: (see an example at line 28) to make them stand out among the other framework messages.
2) More human-friendly.
3) Reasonably script-friendly.
E.g.: The final string at line 77 is only there for our Continuous Integration tools to identify the end of the test session.
Regards, Sandrine Bailleux