https://progress.opensuse.org/https://progress.opensuse.org/themes/openSUSE/favicon/favicon.ico?15829177842020-11-26T07:59:10ZopenSUSE Project Management ToolopenQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3543342020-11-26T07:59:10ZXiaojing_liuxliu1@suse.com
<ul><li><strong>Blocks</strong> <i><a class="issue tracker-6 status-3 priority-4 priority-default closed child parent" href="/issues/67723">coordination #67723</a>: [epic] Remote openQA worker fails to run tests from openqa-clone-custom-git-refspec</i> added</li></ul> openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3551362020-11-27T09:52:22Zokurzokurz@suse.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/355136/diff?detail_id=352410">diff</a>)</li></ul> openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3557402020-12-01T09:47:11Zlivdywanliv.dywan@suse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Feedback</i></li></ul><p>Another approach from Jane is being discussed on GitHub, hence <em>Feedback</em>:</p>
<p><a href="https://github.com/os-autoinst/openQA/pull/3604" class="external">https://github.com/os-autoinst/openQA/pull/3604</a></p>
openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3558382020-12-01T16:24:33Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Feedback</i> to <i>Workable</i></li></ul><p>it's good that we explore the ideas but actually I would like to set the epic to "Workable" as anyone can be the epic owner and create according subtasks</p>
openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3581302020-12-14T23:09:25Zokurzokurz@suse.com
<ul></ul><p>Based on our discussion today and me looking into the current use of DISTRI and other variables within os-autoinst I am once again sure that we should not need any additional variables within os-autoinst.<br>
Unless I am mistaken os-autoinst already has all variables that are needed to describe all possible situations that we need to support. And all variables should support relative directories, i.e. CASEDIR, PRODUCTDIR, NEEDLES_DIR. We already mentioned this in <a href="https://github.com/os-autoinst/os-autoinst/pull/1569#discussion_r529016541">https://github.com/os-autoinst/os-autoinst/pull/1569#discussion_r529016541</a> .</p>
<p>My suggestion in <a href="https://github.com/os-autoinst/openQA/pull/3604#issuecomment-736575668">https://github.com/os-autoinst/openQA/pull/3604#issuecomment-736575668</a> is still true, mainly about relative directories and providing symlinks within the scope of openQA.</p>
<p>My idea is (still) that with just relative directories specified by openQA and all necessary data available from these relatives directories it should be possible to fully specify what os-autoinst needs but still provide clone-able jobs.<br>
I am trying to come up with some different cases we need to support with according example variable settings:</p>
<ol>
<li><em>absolute casedir path with needles in same repo, no caching, no git</em>: <code>casedir=/var/lib/openqa/share/tests/foo</code> (+ needles in <code>needles/</code>, not necessary to specify, read by default in <a href="https://github.com/os-autoinst/os-autoinst/blob/master/needle.pm#L324">https://github.com/os-autoinst/os-autoinst/blob/master/needle.pm#L324</a>)</li>
<li><em>absolute casedir path with productdir, no caching, no git</em>: <code>casedir=/var/lib/openqa/share/tests/foo</code> + <code>productdir=products/opensuse</code> (+ needles in <code>needles/</code>, now relative to productdir, still not necessary to specify, also covered by <a href="https://github.com/os-autoinst/os-autoinst/blob/master/needle.pm#L324">https://github.com/os-autoinst/os-autoinst/blob/master/needle.pm#L324</a>)</li>
<li><em>casedir path with productdir, caching, no git</em>: <code>casedir=foo</code> (symlink to /var/lib/…/cache/…) + <code>productdir=products/opensuse</code> (+ needles in <code>needles/</code>, still relative to productdir, same as in 2.)</li>
<li><em>casedir path with productdir, caching, git, needles not in same git</em>: <code>casedir=https://github.com/my/repo</code> + <code>productdir=products/opensuse</code> + <code>needles_dir=needles</code> (now specified explicitly, symlinked from cache into pool)</li>
</ol>
<p>So with this I expect that we can get the change done without needing to change anything in os-autoinst, just by providing symlinks in the openQA worker pool directory and specifying relative directory variables instead of absolute ones.</p>
openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3605352021-01-04T11:48:11ZXiaojing_liuxliu1@suse.com
<ul><li><strong>Blocks</strong> <i><a class="issue tracker-4 status-3 priority-4 priority-default closed child" href="/issues/81703">action #81703</a>: The values of 'ISO' and 'HDD' includes absolute path in vars.json</i> added</li></ul> openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3605412021-01-04T11:48:53ZXiaojing_liuxliu1@suse.com
<ul><li><strong>Blocks</strong> deleted (<i><a class="issue tracker-4 status-3 priority-4 priority-default closed child" href="/issues/81703">action #81703</a>: The values of 'ISO' and 'HDD' includes absolute path in vars.json</i>)</li></ul> openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3800452021-01-23T17:29:28Zokurzokurz@suse.com
<ul></ul><p><a href="https://github.com/os-autoinst/openQA/pull/3604" class="external">https://github.com/os-autoinst/openQA/pull/3604</a> was merged and reverted again in <a href="https://github.com/os-autoinst/openQA/pull/3693" class="external">https://github.com/os-autoinst/openQA/pull/3693</a> after an error report <a href="https://github.com/os-autoinst/openQA/pull/3604#issuecomment-765888161" class="external">https://github.com/os-autoinst/openQA/pull/3604#issuecomment-765888161</a></p>
openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3810972021-01-29T14:17:25Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Workable</i> to <i>Blocked</i></li><li><strong>Assignee</strong> set to <i>okurz</i></li></ul> openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=3927112021-03-18T13:02:30Zokurzokurz@suse.com
<ul><li><strong>Tracker</strong> changed from <i>action</i> to <i>coordination</i></li></ul> openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=4051572021-05-07T11:34:51Zokurzokurz@suse.com
<ul><li><strong>Copied to</strong> <i><a class="issue tracker-6 status-15 priority-4 priority-default child parent" href="/issues/92314">coordination #92314</a>: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideo - further cleanup</i> added</li></ul> openQA Project - coordination #80372: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideohttps://progress.opensuse.org/issues/80372?journal_id=4051692021-05-07T11:36:01Zokurzokurz@suse.com
<ul><li><strong>Status</strong> changed from <i>Blocked</i> to <i>Resolved</i></li></ul><p>I tested now. Downloaded vars.json from <a href="https://openqa.opensuse.org/tests/1730497" class="external">https://openqa.opensuse.org/tests/1730497</a> and with a command <code>ln -sf ~/local/os-autoinst/opensuse && isotovideo -d iso=~/local/tmp/openSUSE-Leap-15.2-NET-x86_64.iso</code> I could successfully start tests so that covers AC2.</p>
<p><a href="https://openqa.opensuse.org/tests/1730365#investigation" class="external">https://openqa.opensuse.org/tests/1730365#investigation</a> shows no cache related changes for an investigation showing the diff between two jobs on different worker machines and instances which covers AC3. AC1 is already covered by the referenced ticket. The subtask <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: The values of 'ISO' and 'HDD' includes absolute path in vars.json (Resolved)" href="https://progress.opensuse.org/issues/81703">#81703</a> is still open but can be followed up with independant of AC1-3 so I split out an epic <a class="issue tracker-6 status-15 priority-4 priority-default child parent" title="coordination: [epic] Cleanup vars.json as initial information container between openQA worker and isotovideo - ... (Blocked)" href="https://progress.opensuse.org/issues/92314">#92314</a> , set that as parent for <a class="issue tracker-4 status-3 priority-4 priority-default closed child" title="action: The values of 'ISO' and 'HDD' includes absolute path in vars.json (Resolved)" href="https://progress.opensuse.org/issues/81703">#81703</a> and resolving the current ticket.</p>