Project

General

Profile

Actions

action #57845

closed

openQA Tests - coordination #15132: [saga][epic] Better structure of test plans in main.pm

coordination #44360: [epic] Parameterize test suites within job groups

coordination #55730: [epic] Move parameters from test suites into job groups

Switch more job groups to YAML job templates

Added by okurz over 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Organisational
Target version:
Start date:
2019-10-09
Due date:
% Done:

0%

Estimated time:
Actions #1

Updated by okurz over 4 years ago

  • Due date changed from 2019-10-22 to 2019-11-05

As discussed in the QA tools weekly meeting 2019-10-22 and announced in http://mailman.suse.de/mlarch/SuSE/openqa/2019/openqa.2019.10/msg00005.html we will await SLE12SP5 GM gold declaration and then switch over all remaining job groups to the YAML format.

Actions #2

Updated by okurz over 4 years ago

  • Due date changed from 2019-11-05 to 2019-11-19
Actions #3

Updated by okurz over 4 years ago

  • Due date changed from 2019-11-19 to 2019-12-17

o3 is fully YAML-only now. osd has select count(id) from job_groups where template is null; -> 114 . Next step: https://github.com/os-autoinst/openQA/pull/2518 for deprecation notice. Follow-up: https://github.com/os-autoinst/openQA/pull/2519 disabling editor functionalities. In weekly tools team meeting we decided to point admins to the UI for saving instead of coming up with a migration script that could break in the background. I assume with this we give users again more time to switch by themselves.

Actions #4

Updated by coolo over 4 years ago

That deprecation warning was not for osd though - there we gave a deprecation warning by email before summer. So go ahead with osd independently of that

Actions #5

Updated by mgriessmeier over 4 years ago

for reference:
Functional group for SLE15 was already migrated, including gitlab-ci with auto deployment in place - same as for YaST job group

Actions #6

Updated by okurz over 4 years ago

Sent email announcement to openqa.suse.de. Saving backup of all job templates with openqa-dump-templates --full --json --host openqa.suse.de > openqa_templates_osd-$(date +%F).json && openqa-dump-templates --full --host openqa.suse.de > openqa_templates_osd-$(date +%F).pl, saved in https://w3.nue.suse.com/~okurz/openqa_osd_backup_job_templates_before_switch_to_yaml_poo57845/

I did a dry-run of the migration with

for i in $(ssh openqa.suse.de "sudo -u geekotest psql --no-align --tuples-only --command=\"select id from job_groups where template is null order by id;\" openqa") ; do curl -s http://openqa.suse.de/api/v1/job_templates_scheduling/$i | openqa-client --json-output --host http://openqa.suse.de job_templates_scheduling/$i post --form schema=JobTemplates-01.yaml preview=1 template="$(cat -)"; done | tee migration_preview.log 2>&1

and have received entries like

{
   "id" : 1,
   "preview" : 1
}

for all job groups. I guess this is a good sign.

And a live change with

for i in $(ssh openqa.suse.de "sudo -u geekotest psql --no-align --tuples-only --command=\"select id from job_groups where template is null order by id;\" openqa") ; do curl -s http://openqa.suse.de/api/v1/job_templates_scheduling/$i | openqa-client --json-output --host http://openqa.suse.de job_templates_scheduling/$i post --form schema=JobTemplates-01.yaml template="$(cat -)"; done | tee migration.log 2>&1

All done. Database query select count(id) from job_groups where template is null; returns 0 job groups left. The ids of all job groups converted can be found in https://w3.nue.suse.com/~okurz/openqa_osd_backup_job_templates_before_switch_to_yaml_poo57845/ as well.

Actions #7

Updated by okurz over 4 years ago

  • Due date changed from 2019-12-17 to 2019-11-19
  • Status changed from Feedback to Resolved

Considered done.

Actions #8

Updated by okurz over 3 years ago

  • Due date deleted (2019-11-19)
Actions

Also available in: Atom PDF