Project

General

Profile

Actions
Copy link

action #166151

closed

coordination #169654: [epic] Create test scenarios for Agama

Enable TAP for agama testing results

Added by JERiveraMoya 8 months ago. Updated 3 months ago.

Status:
Resolved
Priority:
High
Assignee:
lmanfredi
Target version:
-
Start date:
2024-09-02
Due date:
% Done:

0%

Estimated time:
Tags:
qe-yam-jan-sprint-fy25

Description

Motivation

The builtin Node.js test runner supports the Test Anything Protocol (TAP), already supported by openQA.

Acceptance criteria

  • AC1: Play with reporters in node to see which one is more intersting.
  • AC2: Provide PoC reporting in openQA using this protocol for current agama testing with puppeteeer.
  • AC3: Discuss with the squad how it looks and if makes sense or not.

Additional information

Info about the protocol: https://en.wikipedia.org/wiki/Test_Anything_Protocol
Example in openQA using TAP: https://openqa.suse.de/tests/15302729
openQA documentation: https://open.qa/docs/#installing_harness
Test runner reporters: https://nodejs.org/api/test.html#test-reporters

Actions
Copy link
 #1

Updated by JERiveraMoya 8 months ago

  • Subject changed from Create installation for full encryption to Enable TAP for agama testing results
Actions
Copy link
 #2

Updated by JERiveraMoya 8 months ago

  • Description updated (diff)
Actions
Copy link
 #3

Updated by JERiveraMoya 8 months ago

  • Description updated (diff)
Actions
Copy link
 #4

Updated by rainerkoenig 8 months ago

  • Status changed from Workable to In Progress
  • Assignee set to rainerkoenig
Actions
Copy link
 #5

Updated by JERiveraMoya 7 months ago

  • Status changed from In Progress to Workable
Actions
Copy link
 #6

Updated by JERiveraMoya 7 months ago

Moved to workable as there is still work to do on https://progress.opensuse.org/issues/163946

Actions
Copy link
 #7

Updated by JERiveraMoya 7 months ago

  • Tags changed from qe-yam-sep-sprint to qe-yam-oct-sprint
  • Assignee deleted (rainerkoenig)

Cleaning assignee as entering in new sprint.

Actions
Copy link
 #8

Updated by JERiveraMoya 6 months ago

  • Tags changed from qe-yam-oct-sprint to qe-yam-nov-sprint
Actions
Copy link
 #9

Updated by JERiveraMoya 6 months ago

  • Tags deleted (qe-yam-nov-sprint)
  • Status changed from Workable to New
Actions
Copy link
 #10

Updated by JERiveraMoya 6 months ago

  • Parent task changed from #163919 to #169654
Actions
Copy link
 #11

Updated by JERiveraMoya 6 months ago

  • Tags set to qe-yam-nov-sprint
  • Status changed from New to Workable
Actions
Copy link
 #12

Updated by JERiveraMoya 6 months ago

  • Status changed from Workable to New
Actions
Copy link
 #13

Updated by JERiveraMoya 6 months ago

  • Tags deleted (qe-yam-nov-sprint)
Actions
Copy link
 #14

Updated by JERiveraMoya 6 months ago

  • Priority changed from High to Normal
Actions
Copy link
 #15

Updated by JERiveraMoya 4 months ago

  • Tags set to qe-yam-jan-sprint-fy25
  • Status changed from New to Workable
  • Priority changed from Normal to High
Actions
Copy link
 #16

Updated by JERiveraMoya 4 months ago

  • Tags changed from qe-yam-jan-sprint-fy25 to qe-yam-dec-sprint-fy25
Actions
Copy link
 #17

Updated by JERiveraMoya 4 months ago

  • Tags changed from qe-yam-dec-sprint-fy25 to qe-yam-jan-sprint-fy25
Actions
Copy link
 #18

Updated by lmanfredi 4 months ago

  • Status changed from Workable to In Progress
  • Assignee set to lmanfredi
Actions
Copy link
 #19

Updated by lmanfredi 4 months ago

Actions
Copy link
 #20

Updated by lmanfredi 4 months ago

Last example in openQA using TAP: podman_testsuite

Actions
Copy link
 #21

Updated by lmanfredi 4 months ago

Created PRs:

  • os-autoinst-distri-opensuse PR#20912
  • agama-integration-test-webpack PR#61
Actions
Copy link
 #22

Updated by JERiveraMoya 3 months ago

Good job! please add the description in the job group yaml running that test suite, basically the exact text that we miss now without subtests.
Please apply for the rest of tests in puppeteer adding corresponding descriptions.

Actions
Copy link
 #23

Updated by lmanfredi 3 months ago

Created PRs:

  • os-autoinst-distri-opensuse PR#20952
  • agama-integration-test-webpack PR#67

with multiple-reporters

Actions
Copy link
 #24

Updated by lmanfredi 3 months ago

PRs merged

Actions
Copy link
 #25

Updated by JERiveraMoya 3 months ago

  • Status changed from In Progress to Resolved

Let's resolve it, good job! you covered all the angles we thought would help.
We can file other ticket for more improvements, this already has a great quality IMO.

Actions
Copy link

Also available in: Atom PDF