https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842017-03-27T06:02:16ZopenSUSE Project Management ToolopenQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=450642017-03-27T06:02:16Zokurz@suse.deokurz@suse.de
<ul></ul><p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a>,</p>
<blockquote>
<p>action <a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: [sles][migration][s390x] find proper way of handling image creation for migration on zKVM (Resolved)" href="https://progress.opensuse.org/issues/18016">#18016</a>: [sles][migration][s390x] test failes in setup_zdup because<br>
zkvm fails to select x11 console <a href="https://progress.opensuse.org/issues/18016" class="external">https://progress.opensuse.org/issues/18016</a><br>
[…]<br>
<a href="https://openqa.suse.de/tests/838567" class="external">https://openqa.suse.de/tests/838567</a></p>
</blockquote>
<p>would that require an additional <code>reset_consoles</code> here? isn't that the common <br>
cause of "incomplete" when it should rather be caught in the test and fail <br>
with a helpful error message?</p>
<p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a>, can you try to put in a <code>testapi::record_info</code> call if this <br>
happens and ensure there is no crash file written so that the test aborts with <br>
failed and not incomplete</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=450742017-03-27T07:20:57Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>Assignee</strong> set to <i>mgriessmeier</i></li></ul><p><a href="mailto:okurz@suse.de">okurz@suse.de</a> wrote:</p>
<blockquote>
<p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a>,</p>
<blockquote>
<p>action <a class="issue tracker-4 status-3 priority-4 priority-default closed" title="action: [sles][migration][s390x] find proper way of handling image creation for migration on zKVM (Resolved)" href="https://progress.opensuse.org/issues/18016">#18016</a>: [sles][migration][s390x] test failes in setup_zdup because<br>
zkvm fails to select x11 console <a href="https://progress.opensuse.org/issues/18016" class="external">https://progress.opensuse.org/issues/18016</a><br>
[…]<br>
<a href="https://openqa.suse.de/tests/838567" class="external">https://openqa.suse.de/tests/838567</a></p>
</blockquote>
</blockquote>
<p>The problem is, that the image was not created on the right worker - I'm doing this right now and will upload the new image after that<br>
For the future: </p>
<ul>
<li>make sure that every image which you want to create with <code>PUBLISH_HDD_1</code> is running on <code>WORKER_CLASS=zkvm-imag</code>e as well as the corresponding upgrade job (also needs to have <code>WORKER_CLASS=zkvm-image</code></li>
</ul>
<blockquote>
<p>would that require an additional <code>reset_consoles</code> here? isn't that the common <br>
cause of "incomplete" when it should rather be caught in the test and fail <br>
with a helpful error message?</p>
<p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a>, can you try to put in a <code>testapi::record_info</code> call if this <br>
happens and ensure there is no crash file written so that the test aborts with <br>
failed and not incomplete</p>
</blockquote>
<p>I'll put it on my todo list</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=450962017-03-27T09:00:19Zmgriessmeiermgriessmeier@suse.com
<ul></ul><ul>
<li>Re-Added this image created by the correct worker</li>
<li>Changed all Migration tests in test-development to use WORKER_CLASS zkvm-image
Should be working with the next build</li>
</ul>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=451062017-03-27T09:20:48Zqmsuqingming.su@suse.com
<ul></ul><p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a> </p>
<p>I see the changes, thanks.<br>
I will check the results of Migration tests in test-development on next build to confirm it works. </p>
<p>Actually we need prepare more s390x hdd images for zdup_offline/online migration tests (i.e. sle12sp1+sdk, sle12sp1+ha+geo, ... sle12sp2+sdk, sle12sp2+ha+geo, etc).<br>
So would you please send me the parameters you posted the job to create this sle12sp2 hdd image? Then I can generate all required images by myself.</p>
<p>Thanks.</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=451102017-03-27T09:32:27Zmgriessmeiermgriessmeier@suse.com
<ul></ul><p>Hi,</p>
<p>So the general approach would be to clone the corresponding job (e.g. sle12sp1+sdk) from openqa.suse.de to openqa.suse.de and add the PUBLISH_HDD_1 variable</p>
<p>I did it like this: <br>
<code>/usr/share/openqa/script/clone_job.pl --host https://openqa.suse.de --from https://openqa.suse.de $JOB_ID INSTALLONLY=1 WORKER_CLASS=zkvm-image PUBLISH_HDD_1=$HDD_IMAGE_NAME _GROUP=0</code></p>
<p>NOTES: <br>
Using <code>INSTALLONLY=1</code> is enough for the creation of the image, no need for consoletests<br>
Using <code>WORKER_CLASS=zkvm-images</code> is mandatory because otherwise the IPs are not matching (will hopefully be fixed in the future)<br>
Using <code>_GROUP=0</code> is highly recommended, because it ensures that the creation job will not pollute any existing job group</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=451142017-03-27T09:44:48Zqmsuqingming.su@suse.com
<ul></ul><p>Got it. Thanks.<br>
I will try it.</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=451242017-03-27T10:47:11Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Subject</strong> changed from <i>[sles][migration][s390x] test failes in setup_zdup because zkvm fails to select x11 console</i> to <i>[sles][migration][s390x] find proper way of handling image creation for migration on zKVM</i></li><li><strong>Category</strong> changed from <i>Bugs in existing tests</i> to <i>Infrastructure</i></li></ul><p>Changed subject - since the original ticket was caused by this - but we should track it</p>
<p>So for now, all the zKVM guests use static ip adresses, that's why we need a dedicated workerclass for it to ensure that the created image can be booted correctly<br>
This is bad in several points:</p>
<ol>
<li>we can only run one migration at one time</li>
<li>we need to ensure that the image is always created on the correct worker</li>
</ol>
<p>Suggestion:<br>
Use a proper dhcp setup on s390pb to avoid this issue<br>
=> I already created a ticket to <a href="mailto:infra@suse.de">infra@suse.de</a> for this: <br>
<a href="https://infra.nue.suse.com/Ticket/Display.html?id=66714" class="external">https://infra.nue.suse.com/Ticket/Display.html?id=66714</a></p>
<p>Let's use this ticket for tracking this</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=458142017-03-31T07:15:47Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Blocks</strong> <i><a class="issue tracker-4 status-3 priority-5 priority-high3 closed parent" href="/issues/13216">action #13216</a>: [sles][functional][s390x] Run extratest on s390x</i> added</li></ul> openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=493422017-05-08T08:39:43Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Assignee</strong> deleted (<del><i>mgriessmeier</i></del>)</li></ul><p>not working on this right now, image-creation is working fine, if the image gets created on the right worker, which is handled pretty well by all people at the moment</p>
<p>Unassigning for now, feel free to ask if you plan to work on this</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=524122017-06-02T17:05:53Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Feedback</i></li><li><strong>Assignee</strong> set to <i>mgriessmeier</i></li></ul><blockquote>
<p><a href="https://infra.nue.suse.com/Ticket/Display.html?id=66714" class="external">https://infra.nue.suse.com/Ticket/Display.html?id=66714</a></p>
</blockquote>
<p>I put a friendly <em>bump</em> in that infra ticket.</p>
<p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a> I assume you have no problem tracking that ticket in "feedback" status now as you also now gschlotter personally.</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=582562017-07-26T14:17:11Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>In Progress</i></li><li><strong>Assignee</strong> changed from <i>mgriessmeier</i> to <i>okurz</i></li></ul><p><a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3343" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3343</a></p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=584502017-07-28T07:53:53Zokurzokurz@suse.com
<ul></ul><p><a href="https://openqa.suse.de/tests/1081373#step/patch_before_migration/54" class="external">https://openqa.suse.de/tests/1081373#step/patch_before_migration/54</a> running good so far on o.s.d on a different worker, but this costs us 6 minutes of useless waiting :/</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=585162017-07-28T11:26:30Zokurzokurz@suse.com
<ul></ul><p><a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3356" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/3356</a> for the enhancement, merged, synced to osd.</p>
<p>verification job on osd triggered: <a href="https://openqa.suse.de/tests/1081424#live" class="external">https://openqa.suse.de/tests/1081424#live</a>, waiting</p>
<p>EDIT: Failed because couldn't find <a href="http://openqa.suse.de/assets/repo/SLE-12-SP3-SERVER-POOL-s390x-Build0473-Media1/" class="external">http://openqa.suse.de/assets/repo/SLE-12-SP3-SERVER-POOL-s390x-Build0473-Media1/</a> . Seems the repo is already cleaned up. IMHO too much effort to make it work for SLE12SP3 right now. Let's just assume it works and continue, ok?</p>
<p>I guess the next step would be to get rid of the zkvm-images worker class in all job schedules.</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=585562017-07-28T12:04:33Zokurzokurz@suse.com
<ul></ul><p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a>: Do we still need <a href="https://infra.nue.suse.com/SelfService/Display.html?id=66714" class="external">https://infra.nue.suse.com/SelfService/Display.html?id=66714</a> ?</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=585582017-07-28T12:25:23Zmgriessmeiermgriessmeier@suse.com
<ul></ul><p>okurz wrote:</p>
<blockquote>
<p><a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a>: Do we still need <a href="https://infra.nue.suse.com/SelfService/Display.html?id=66714" class="external">https://infra.nue.suse.com/SelfService/Display.html?id=66714</a> ?</p>
</blockquote>
<p>nope - I commented in the ticket and suggested to close it</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=586522017-07-31T12:58:51Zokurzokurz@suse.com
<ul></ul><p>waiting for riafarov and me to rework the templates at first for sle15, then we can adapt this step as well</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=611562017-08-29T08:08:29Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>File</strong> <a href="/attachments/3482">dump.diff</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/3482/dump.diff">dump.diff</a> added</li></ul><p>all occurences of zkvm-image got replaced to use the machine 'zkvm'<br>
see attached dump.diff</p>
<p>see also PR for removing the worker_class from the workers.ini:<br>
<a href="https://gitlab.suse.de/openqa/salt-pillars-openqa/merge_requests/51" class="external">https://gitlab.suse.de/openqa/salt-pillars-openqa/merge_requests/51</a></p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=612322017-08-29T13:52:36Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p>MR merged. I also did not find any left over references of zkvm-image(s) in neither os-autoinst nor our tests so we should be done here.</p>
openQA Tests - action #18016: [sles][migration][s390x] find proper way of handling image creation for migration on zKVMhttps://progress.opensuse.org/issues/18016?journal_id=2701012020-01-10T13:56:57Zpvorelpetr.vorel@suse.com
<ul></ul><p>I consider<br>
multiple calls of save_svirt_pty as a bug: it slows down testing,<br>
see LTP tests on s390x (svirt backend):</p>
<p><a href="https://openqa.suse.de/tests/3766791#step/boot_ltp/9" class="external">https://openqa.suse.de/tests/3766791#step/boot_ltp/9</a></p>
<p>BTW: <a href="https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9290" class="external">https://github.com/os-autoinst/os-autoinst-distri-opensuse/pull/9290</a></p>