QA » openQA Project

my opinion: we should also try to avoid using the word "test" in the future, as it will remain ambiguous. Will be better to use job, testrun, testresult, teststep, testsuite etc. to be more precise what is meant. We don't really want to start a glossar documentation section.

We need a name for the specific composition of <distri>-<version>-<flavor>-<arch>-<scenario> (e.g. openSUSE-Tumbleweed-DVD-x86_64-gnome).
I just checked and it seems that "scenario" is so far only used very sparingly within the openQA repository and inconsistently so i would like to call the above "scenario". I don't mind also giving it a cute nickname "koala", see #10212#note-12 for details (koalas are cute and it's a funny name to remember easily).

I second the opinion of bmwiedemann and therefore do not propose to implement ancorgs suggestion of renaming. But what we are doing here is actually starting a "glossar documentation section" ;-)

So we have

• test modules: an individual test case in a single perl module file, e.g. "sshxterm". If not further specified a test module is denoted with its "short name" equivalent to the filename including the test definition. The "full name" is composed of the test group (TBC), which itself is formed by the top-folder of the test module file, and the short name, e.g. "x11-sshxterm" (for x11/sshxterm.pm)
• test suite: a collection of test modules, e.g. "textmode". All test modules within one test suite are run serially
• job: one run of individual test cases in a row denoted by a unique number for one instance of openQA, e.g. one installation with subsequent testing of applications within gnome
• test run: equivalent to job
• test result: the result of one job, e.g. "passed" with the details of each individual test module
• test step: the execution of one test module within a job
• distri: a test distribution but also sometimes referring to a product (CAUTION: ambiguous, historically a "GNU/Linux distribution"), composed of multiple test modules in a folder structure that compose test suites, e.g. "opensuse" (test distribution, short for "os-autoinst-distri-opensuse")
• product: the main "system under test" (SUT), e.g. "openSUSE"
• job group: equivalent to product, used in context of the webUI
• version: one version of a product, don't confuse with builds, e.g. "Tumbleweed"
• flavor: a specific variant of a product to distinguish differing variants, e.g. "DVD"
• arch: an architecture variant of a product, e.g. "x86_64"
• scenario: A composition of <distri>-<version>-<flavor>-<arch>-<scenario>, e.g. "openSUSE-Tumbleweed-DVD-x86_64-gnome", nicknamed koala
• build: Different versions of a product as tested, can be considered a "sub-version" of version, e.g. "Build1234"; CAUTION: ambiguity: either with the prefix "Build" included or not)

Corrections? If not I will probably eventually put this on some wiki or a text document within openQA