QA » openQA Project » openQA Tests » qe-yam

Created openqa-job-groups-migrations MR#412

The refactoring was done following these steps:

• SPLIT_FILE
• COPY_SCRIPTS
• REMOVE_FILE

all steps has been done using this bash script:

#!/usr/bin/env bash
set -e

repo_dir="$HOME/GitLab/openqa-job-groups-migrations"

function SPLIT_FILE() {
  cd $repo_dir
  mkdir -p JobGroups/migration_miscellaneous
  cd JobGroups
  yq '{"defaults":.defaults,"products":.products} | sort_keys(..) | ... comments=""' migration_miscellaneous.yaml > migration_miscellaneous/defaults.yaml
  yq '{"aarch64": .scenarios.aarch64 | sort_keys(..) | ... comments="" }' migration_miscellaneous.yaml > migration_miscellaneous/aarch64.yaml
  yq '{"ppc64le": .scenarios.ppc64le | sort_keys(..) | ... comments="" }' migration_miscellaneous.yaml > migration_miscellaneous/ppc64le.yaml
  yq '{"s390x":   .scenarios.s390x   | sort_keys(..) | ... comments="" }' migration_miscellaneous.yaml > migration_miscellaneous/s390x.yaml
  yq '{"x86_64":  .scenarios.x86_64  | sort_keys(..) | ... comments="" }' migration_miscellaneous.yaml > migration_miscellaneous/x86_64.yaml
  yq --null-input '{"test_suites":{} } | . head_comment="this yaml contains anchors"' > test_suites.yaml
}

function COPY_SCRIPTS() {
  cd $repo_dir
  cp -r $HOME/GitLab/openqa-job-groups/scripts .
  cp $HOME/GitLab/openqa-job-groups/.yamllint .
  # Adapt by hand $HOME/GitLab/openqa-job-groups/.gitlab-ci.yml
  # cp $HOME/GitLab/openqa-job-groups/.gitlab-ci.yml .
  # Adapt by hand $HOME/GitLab/openqa-job-groups/JobGroups/header
  # cp $HOME/GitLab/openqa-job-groups/JobGroups/header JobGroups/header 
}

function REMOVE_FILE() {
  cd $repo_dir
  git rm JobGroups/migration_miscellaneous.yaml
}

SPLIT_FILE
COPY_SCRIPTS
REMOVE_FILE

The task needs to be done in https://gitlab.suse.de/qe-yam/openqa-job-groups, splitting doesn't have much value, unifying does. Repeating those CI files in another repo is also a big mistake, we talked about that in weekly syncs, because someone else try to do the same. I see AC2 is not good enough described, the "Split" word is still very confusing. I would advice in this case always to check previous tasks related.

Nice script! btw, still could be useful for other tasks, what I'm not sure is about the sorting, perhaps there are ordered in a particular way.

Closed openqa-job-groups-migrations MR#412.
The task will be done in openqa-job-groups repo, as indicated in previous #note-6

Created openqa-job-groups MR#29

The refactoring was done following these steps:

• CREATE_GIT_BRANCH
• SPLIT_FILE

all steps has been done using this bash script:

#!/usr/bin/env bash
set -e
echo "# issues/151657"

repo_orig="$HOME/GitLab/openqa-job-groups-migrations"
repo_dest="$HOME/GitLab/openqa-job-groups"

function CREATE_GIT_BRANCH() {
  cd $repo_dest
  git checkout -b issues-151657
}

function SPLIT_FILE() {
  mkdir -p $repo_dest/JobGroups/migration_miscellaneous
  yq '{"defaults":.defaults,"products":.products} | sort_keys(..) | ... comments=""' $repo_orig/JobGroups/migration_miscellaneous.yaml > $repo_dest/JobGroups/migration_miscellaneous/defaults.yaml
  yq '{"aarch64": .scenarios.aarch64 | sort_keys(..) | ... comments="" }' $repo_orig/JobGroups/migration_miscellaneous.yaml > $repo_dest/JobGroups/migration_miscellaneous/aarch64.yaml
  yq '{"ppc64le": .scenarios.ppc64le | sort_keys(..) | ... comments="" }' $repo_orig/JobGroups/migration_miscellaneous.yaml > $repo_dest/JobGroups/migration_miscellaneous/ppc64le.yaml
  yq '{"s390x":   .scenarios.s390x   | sort_keys(..) | ... comments="" }' $repo_orig/JobGroups/migration_miscellaneous.yaml > $repo_dest/JobGroups/migration_miscellaneous/s390x.yaml
  yq '{"x86_64":  .scenarios.x86_64  | sort_keys(..) | ... comments="" }' $repo_orig/JobGroups/migration_miscellaneous.yaml > $repo_dest/JobGroups/migration_miscellaneous/x86_64.yaml
  # Adapt $repo_dest/.gitlab-ci.yml
}


CREATE_GIT_BRANCH
SPLIT_FILE

GitLab CI adapted by adding:

variables:
  GROUPID_MIGRATION_MISCELLANEOUS: 478

test_migration_miscellaneous:
  stage: test
  before_script:
    - git clone --depth 1 $URL_TEST_REPO
  script:
    - scripts/ci_runner_test.sh migration_miscellaneous $GROUPID_MIGRATION_MISCELLANEOUS
  only:
    refs:
      - merge_requests
    changes:
      - JobGroups/*
      - JobGroups/migration_miscellaneous/*
      - .gitlab-ci.yml
  retry: 2

deploy_migration_miscellaneous:
  stage: deploy
  script:
    - scripts/ci_runner_deploy.sh migration_miscellaneous $GROUPID_MIGRATION_MISCELLANEOUS
  only:
    refs:
      - master
    changes:
      - JobGroups/*
      - JobGroups/migration_miscellaneous/*
      - .gitlab-ci.yml

Merged openqa-job-groups MR#29

Created openqa-job-groups MR#33 to fix missing comments

Merged openqa-job-groups MR#33