QA (public) » openQA Project (public)

In preparation of the upgrade I am already migrating postgres to 16:

oldver=15 newver=16
zypper in postgresql$newver-server postgresql$newver-contrib
sudo -u postgres /usr/lib/postgresql$newver/bin/initdb --encoding=UTF8 --locale=en_US.UTF-8 --lc-collate=C --lc-ctype=en_US.UTF-8 --lc-messages=C --lc-monetary=C --lc-numeric=C --lc-time=C -D /var/lib/pgsql/data.$newver
sudo -u postgres vimdiff /var/lib/pgsql/data.$oldver/postgresql.conf /var/lib/pgsql/data.$newver/postgresql.conf
sudo -u postgres /usr/lib/postgresql$newver/bin/pg_upgrade --check --link --old-bindir=/usr/lib/postgresql$oldver/bin --new-bindir=/usr/lib/postgresql$newver/bin --old-datadir=/var/lib/pgsql/data.$oldver --new-datadir=/var/lib/pgsql/data.$newver && systemctl stop openqa-webui openqa-scheduler openqa-livehandler openqa-gru postgresql && sudo -u postgres /usr/lib/postgresql$newver/bin/pg_upgrade --link --old-bindir=/usr/lib/postgresql$oldver/bin --new-bindir=/usr/lib/postgresql$newver/bin --old-datadir=/var/lib/pgsql/data.$oldver --new-datadir=/var/lib/pgsql/data.$newver && ln --force --no-dereference --relative --symbolic /var/lib/pgsql/data.$newver /var/lib/pgsql/data && systemctl start postgresql openqa-webui openqa-scheduler openqa-livehandler openqa-gru && sudo -u geekotest psql -c 'select version();' openqa

#157978

o3 webUI upgrade done. No relevant problems encountered.

Upgrade conducted. After running zypper dup openqa-webui and openqa-gru failed with:

openqa:~ # systemctl status --failed
× openqa-gru.service - The openQA daemon for various background tasks like cleanup and saving needles
     Loaded: loaded (/usr/lib/systemd/system/openqa-gru.service; enabled; preset: disabled)
    Drop-In: /etc/systemd/system/openqa-gru.service.d
             └─30-openqa-hook-timeout.conf, override.conf
     Active: failed (Result: exit-code) since Wed 2024-10-16 18:10:59 UTC; 6min ago
   Duration: 2ms
   Main PID: 7394 (code=exited, status=217/USER)

Oct 16 18:10:59 openqa systemd[1]: openqa-gru.service: Scheduled restart job, restart counter is at 5.
Oct 16 18:10:59 openqa systemd[1]: Stopped The openQA daemon for various background tasks like cleanup and saving needles.
Oct 16 18:10:59 openqa systemd[1]: openqa-gru.service: Start request repeated too quickly.
Oct 16 18:10:59 openqa systemd[1]: openqa-gru.service: Failed with result 'exit-code'.
Oct 16 18:10:59 openqa systemd[1]: Failed to start The openQA daemon for various background tasks like cleanup and saving needles.

× openqa-webui.service - The openQA web UI
     Loaded: loaded (/usr/lib/systemd/system/openqa-webui.service; enabled; preset: disabled)
    Drop-In: /etc/systemd/system/openqa-webui.service.d
             └─30-openqa-webui-hook-timeout.conf, storage.conf
     Active: failed (Result: exit-code) since Wed 2024-10-16 18:10:58 UTC; 6min ago
   Duration: 3ms
   Main PID: 7357 (code=exited, status=217/USER)

Oct 16 18:10:58 openqa systemd[1]: Started The openQA web UI.
Oct 16 18:10:58 openqa (i-daemon)[7357]: openqa-webui.service: Failed to determine user credentials: No such process
Oct 16 18:10:58 openqa (i-daemon)[7357]: openqa-webui.service: Failed at step USER spawning /usr/share/openqa/script/openqa-webui-daemon: No such process
Oct 16 18:10:58 openqa systemd[1]: openqa-webui.service: Main process exited, code=exited, status=217/USER
Oct 16 18:10:58 openqa systemd[1]: openqa-webui.service: Failed with result 'exit-code'.
Oct 16 18:14:54 openqa systemd[1]: openqa-webui.service: Unit cannot be reloaded because it is inactive.

But after a reboot all issues went away and systemd reports "State: running".

I will monitor some jobs over the evening and will resolve tomorrow if no problems arise.

https://suse.slack.com/archives/C02CANHLANP/p1729129131475009 was reported which I looked into and caused https://progress.opensuse.org/issues/168358
Now checking again if the additional restart of the nfs-server might have fixed the original problem already and we can remove the transient workaround (nolocks option to the nfs client) applied from @okurz.

Setting due date based on mean cycle time of SUSE QE Tools

I consider the upgrade itself done. See linked issues for the related NFS issues and how they got addressed. Consider reopening them instead of this one.