QA » openQA Project

I had a conversation with Anton yesterday regarding this ticket.

One thing to note, is that this is only meant to allow projects that want to execute their own test suites within openQA, and have openQA to also display these results.

One idea is to use LTP as use case, and there is also the Open Build Service tests that are also doing something similar.

I'm working on this since yesterday

Current requirements to be able to use the external results parser resolve to:

• Using a compatible format that is registered in OpenQA::Schema::Result::Jobs::parse_extra_tests

• The test results from the external Harness can be uploaded via testapi::parse_extra_log($output_file) within an openQA tests.

  script_run('prove --verbose --formatter=TAP::Formatter::JUnit t/28-logging.t > junit-logging.xml');
  parse_extra_log('XUnit', 'junit-logging.xml');

Current examples of the formats are in the t/data directory:

• LTP
• LTP New format
• JUnit
• XUnit

Once the files have been uploaded, currently openQA will display them as shown in the atached image, which is simply by adding an extra row with the text results.

• It should be noted that currently only the slenkins junit tests are properly parsed when specifiying JUnit, JUnit parser is specific for slenkins, if the user wishes to use JUnit comming from another source that spills JUnit, then XUnit should be used.
• A TAP parser is being developed here as a poc

poo#34204 still needs work but as for this ticket, we are kind of finished.