https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842019-08-06T09:14:57ZopenSUSE Project Management ToolopenQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2327422019-08-06T09:14:57Zcoolgwwegao@suse.com
<ul></ul><p>History notes:</p>
<p>Wed 12/5/2018 11:56 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by sunyan.<br>
Assignee changed from sunyan to okurz<br>
Sebastian, Oliver, <br>
I had a talk with Oliver about this ticket this afternoon, we are on the same wavelength at the moment.<br>
As I proposed the Implementation steps as below, my team is ready for step 1 and 4, and we are waiting for function team to do step 2 and 5, so that we can continue doing step 3 and 6. Based on the discussion, I move assignee to Oliver. </p>
<a name="----------------Implementation-steps-1-Install-OS-eg-SLE12-SP3-Implement-by-Sunnys-team-2-Start-important-services-and-do-some-configuration-for-these-service-if-it-is-necessary-Encapsulation-module-or-automation-script-Implement-by-Sebastians-team-3-Call-result-of-step-2-to-generate-image-Implement-by-Sunnys-team-4-Migration-eg-from-SLE12-SP3-to-SLE15-GA-Implement-by-Sunnys-team-5-Check-important-services-status-and-configuration-after-migration-Encapsulation-module-or-automation-script-Implement-by-Sebastians-team-6-Call-result-of-step-5-after-migration-Implement-by-Sunnys-team"></a>
<h2 >----------------Implementation steps ----------------------- 1. Install OS (e.g. SLE12 SP3) -- Implement by Sunny's team 2. Start important services and do some configuration for these service if it is necessary (Encapsulation module or automation script) -- Implement by Sebastian's team 3. Call result of step 2 to generate image -- Implement by Sunny's team 4. Migration (e.g. from SLE12 SP3 to SLE15 GA) -- Implement by Sunny's team 5. Check important services' status and configuration after migration (Encapsulation module or automation script) -- Implement by Sebastian's team 6. Call result of step 5 after migration -- Implement by Sunny's team<a href="#----------------Implementation-steps-1-Install-OS-eg-SLE12-SP3-Implement-by-Sunnys-team-2-Start-important-services-and-do-some-configuration-for-these-service-if-it-is-necessary-Encapsulation-module-or-automation-script-Implement-by-Sebastians-team-3-Call-result-of-step-2-to-generate-image-Implement-by-Sunnys-team-4-Migration-eg-from-SLE12-SP3-to-SLE15-GA-Implement-by-Sunnys-team-5-Check-important-services-status-and-configuration-after-migration-Encapsulation-module-or-automation-script-Implement-by-Sebastians-team-6-Call-result-of-step-5-after-migration-Implement-by-Sunnys-team" class="wiki-anchor">¶</a></h2>
<p>Tue 4/30/2019 3:42 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by maritawerner.<br>
Related to action <a class="issue tracker-4 status-6 priority-5 priority-high3 closed" title="action: [sle][migration][backlog] test fails in http_srv - server function test conflict with service test (Rejected)" href="https://progress.opensuse.org/issues/50576">#50576</a>: [sle][migration][SLE12 SP5] test fails in http_srv - server function test conflict with service test added</p>
<p>Tue 5/7/2019 3:19 AM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by sebchlad.<br>
Certain testing for HPC cluster migration will be added. For now slurm migration.</p>
<p>Fri 5/17/2019 6:59 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by mgriessmeier.<br>
Target version changed from Milestone 25+ to Milestone 25</p>
<p>Wed 5/22/2019 9:30 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by okurz.<br>
Assignee changed from okurz to mgriessmeier<br>
<a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a> not sure why you changed from M25+ to just M25. Personally I doubt we can finish this within the current milestone but I will leave the decision how to handle the ticket in particular to you. There are subtasks to follow-on with so maybe just simple tracking here for now.</p>
<p>Wed 5/22/2019 9:30 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by okurz.<br>
Assignee changed from okurz to mgriessmeier<br>
<a class="user active user-mention" href="https://progress.opensuse.org/users/15418">@mgriessmeier</a> not sure why you changed from M25+ to just M25. Personally I doubt we can finish this within the current milestone but I will leave the decision how to handle the ticket in particular to you. There are subtasks to follow-on with so maybe just simple tracking here for now.</p>
<p>Wed 6/5/2019 4:34 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by sunyan.<br>
By talking to Matthias, Rodion, Jose and Marita. We plan to start from a simple example (apache service)<br>
======================+===============================+==================<br>
check point | Before Migration | After Migration<br>
----------------------+-------------------------------+-----------------<br>
----------------------+-------------------------------+--<br>
apache_init | V | V<br>
apache_install | V |<br>
apache_conf_enable | V |<br>
apache_start_service | V |<br>
apache_check_service | V | V<br>
apache_check_conf | V | V<br>
apache_check_function | V | V<br>
======================+===============================+====================<br>
<br>
main.pm (load_patching_tests)<br>
|<br>
install_service.pm (use function of install_services & check_services<br>
in service_check.pm)<br>
|<br>
service_check.pm (call function of "above check point (before<br>
migration)" in http_srv.pm)<br>
|<br>
http_srv.pm (need to encapsulation based on each check point)</p>
<hr>
<p>main_common.pm (load_consoletests)<br>
|<br>
check_upgraded_service.pm (use function of check_services<br>
in service_check.pm)<br>
|<br>
service_check.pm (call function of "above check point (after migration)"<br>
in http_srv.pm)<br>
|<br>
http_srv.pm (need to encapsulation based on each check point)</p>
<hr>
<p>[Benefit]</p>
<ol>
<li><p>Stay in current process (here is no change for calling http_srv.pm in fresh installation process)</p></li>
</ol>
<a name="2-Need-to-encapsulate-function-of-check-point-in-http_srvpm-no-additional-logical-judgment-in-http_srvpm"></a>
<h2 >2. Need to encapsulate function of check point in http_srv.pm, no additional logical judgment in http_srv.pm.<a href="#2-Need-to-encapsulate-function-of-check-point-in-http_srvpm-no-additional-logical-judgment-in-http_srvpm" class="wiki-anchor">¶</a></h2>
<p>[Action item]</p>
<ol>
<li>Sunny team will submit PR of http_srv.pm for wider input and discussion 2. Marita will check with Thorsten which services in this list might have higher priority than others.</li>
<li>If there is any services (in Thorsten's list or not) which don't fit for above work flow proposal, or too complicated (different preconditions in before/after migration setups which we should split), we will discuss them case by case. It will be helpful that Matthias or Jose provide specific example, so that we can review and discuss it together.</li>
</ol>
<p>Wed 6/5/2019 4:26 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by sunyan.<br>
The service list we got from Thorsten are divided by subgroup as below<br>
Function-U:</p>
<ul>
<li>apache</li>
<li>bind</li>
<li>net-snmp</li>
<li>nfs-server</li>
<li>rpcbind</li>
<li>radvd</li>
<li>cron (including all cronjobs, e.g. the in /etc/crontab)</li>
<li>apparmor</li>
<li>autofs</li>
<li>cups</li>
<li>ntp/chrony</li>
<li>postfix</li>
<li>firewall</li>
<li>vsftpd
Kernel/Networking:</li>
<li>kdump</li>
<li>dhcp server</li>
</ul>
<p>Thu 6/6/2019 6:56 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by jlausuch.<br>
If I take the example of DHCP, we don't have specific test cases to exercise different options in DHCP service. We use it though implicitly in some test cases (e.g. Wicked).<br>
So, for the first part (basic sanity check after migration), I agree we can focus on basic functionality (service up with good configuration after migration) and start thinking about adding advanced specific tests for each area/service which is not covered. After SLE12-SP5 we could trigger the "more complex" tests after migration, not only the basic check. </p>
<p>Thu 6/6/2019 5:22 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by maritawerner.<br>
In the PO coordination meeting yesterday the question came up how detailed the Testcases should be. Do we need to test only some basic functionalities of the services or do we need some in-depth testing. <br>
Thorsten told me today that for the beginning he is fine to start with testing basic functionality of the services before and after migration. Since we do not have a lot of experience her he thinks we should also wait for customer feedback and bugs reported to see what realy needs more testing. He also expressed that a lot of the services are not deeply tested during installation and that we might have to work on that first. So he and me agreed that for SLE 12 SP5 we are fine with basic tests, later for SLE 15 SP1 or even SLE 15 SP2 we will rediscuss if deeper testing is needed. And that has to be specified per service. </p>
<p>Thu 6/6/2019 10:20 AM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by hjluo.<br>
Due date set to 06/06/2019<br>
due to changes in a related task<br>
Wed 6/5/2019 5:1[openSUSE Tracker]<br>
Issue #39812 has been updated by coolgw.<br>
Just FYI service_check.pm is used for judge which version will check service etc..<br>
path is /lib/service_check.pm<br>
1 PM</p>
<p>Mon 7/1/2019 4:04 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by mgriessmeier.<br>
Target version changed from Milestone 25 to Milestone 26</p>
<p>Tue 7/16/2019 5:25 PM<br>
[openSUSE Tracker]<br>
Issue #39812 has been updated by hjluo.<br>
File service_check_list.txt added<br>
I've checked all the services to see if they have install, enable, start, check_service{active}, check_function in the tests/console/moduel.pm for before/after migration, please check the attached result file and correct me if I missed something.</p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2328652019-08-07T00:46:25Zcoolgwwegao@suse.com
<ul><li><strong>File</strong> <a href="/attachments/8384">Service_check_list_review20190806.xlsx</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/8384/Service_check_list_review20190806.xlsx">Service_check_list_review20190806.xlsx</a> added</li></ul><p>I have upload the investigation result for service module.</p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2329102019-08-07T06:15:35Zcoolgwwegao@suse.com
<ul><li><strong>File</strong> <a href="/attachments/8387">Service_check_list_review20190807.xlsx</a> <a class="icon-only icon-download" title="Download" href="/attachments/download/8387/Service_check_list_review20190807.xlsx">Service_check_list_review20190807.xlsx</a> added</li></ul><p>New version upload</p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2375752019-08-23T07:11:00Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Target version</strong> changed from <i>Milestone 26</i> to <i>Milestone 27</i></li></ul> openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2435692019-09-16T09:02:49Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Target version</strong> changed from <i>Milestone 27</i> to <i>Milestone 28</i></li></ul> openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2469172019-09-29T19:55:08Zokurzokurz@suse.com
<ul><li><strong>Category</strong> set to <i>New test</i></li></ul> openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2679612020-01-03T08:54:30Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Target version</strong> changed from <i>Milestone 28</i> to <i>Milestone 31</i></li></ul> openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=2828832020-03-04T09:56:03Zmgriessmeiermgriessmeier@suse.com
<ul><li><strong>Priority</strong> changed from <i>High</i> to <i>Normal</i></li><li><strong>Target version</strong> changed from <i>Milestone 31</i> to <i>Milestone 35+</i></li></ul><p>not considering high</p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=3333792020-10-12T13:31:40Zszarate
<ul><li><strong>Tracker</strong> changed from <i>action</i> to <i>coordination</i></li><li><strong>Status</strong> changed from <i>Blocked</i> to <i>New</i></li></ul> openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=3343452020-10-12T13:44:46Zszarate
<ul></ul><p>See for the reason of tracker change: <a href="http://mailman.suse.de/mailman/private/qa-sle/2020-October/002722.html" class="external">http://mailman.suse.de/mailman/private/qa-sle/2020-October/002722.html</a></p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=4542772021-10-12T08:10:15Zokurzokurz@suse.com
<ul><li><strong>Subject</strong> changed from <i>[PjM][saga][migration] Extending Migration testing into functional domains and teams</i> to <i>[PjM][saga][migration][qe-core] Extending Migration testing into functional domains and teams</i></li><li><strong>Assignee</strong> changed from <i>mgriessmeier</i> to <i>tjyrinki_suse</i></li></ul><p>looks like this ticket was not properly transferred to new team structures and new POs hence adding "qe-core" and assigning to current PO of qe-core</p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=4718282021-12-09T13:12:58Ztjyrinki_susetjyrinki+redmine@suse.de
<ul><li><strong>Subject</strong> changed from <i>[PjM][saga][migration][qe-core] Extending Migration testing into functional domains and teams</i> to <i>[migration][PjM][saga] Extending Migration testing into functional domains and teams</i></li><li><strong>Assignee</strong> deleted (<del><i>tjyrinki_suse</i></del>)</li></ul><p>[migration] itself is a squad reference, I think this saga is best driven by QE Migration with possible sub-epics / sub-tasks for other squads.</p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=4805982022-01-17T11:30:17Zmaritawernermawerner@suse.com
<ul></ul><p><a class="user active user-mention" href="https://progress.opensuse.org/users/31682">@coolgw</a> I think we move this ticket to done. The list of services is implemented.</p>
openQA Tests - coordination #55142: [migration][PjM][saga] Extending Migration testing into functional domains and teamshttps://progress.opensuse.org/issues/55142?journal_id=4807992022-01-18T07:44:37Zcoolgwwegao@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Resolved</i></li></ul>