openQA CI: Certain Selenium tests are failing
We are getting failures in the following tests now for every branch and PR:
Sebastian is looking into it, and a bug in chromium or chromedriver seems likely.
The first failure showed up in the dependency PR: https://github.com/os-autoinst/openQA/pull/3929
But it also showed up in a PR from Ivan: https://app.circleci.com/pipelines/github/os-autoinst/openQA/6591/workflows/0a8a7bfa-a845-48f3-95e6-087beb7cb444/jobs/61998/steps
The artifacts/packages.txt is the same as in the last successful run:
#3 Updated by tinita about 2 months ago
Created a bugzilla ticket: https://bugzilla.opensuse.org/show_bug.cgi?id=1186814
#10 Updated by tinita about 2 months ago
Adding a note I wrote to Sebastian:
I think 01-list.t and 15-comments.t could be just a change of behaviour and not necessarily a bug.
10-tests_overview.t is weird because both Sebastian and I ran this without headless mode, and the inspector clearly shows that the
value is like expected.
#11 Updated by mkittler about 2 months ago
- Status changed from Workable to In Progress
I've already been updating the ticket and I'm now also looking into the particular problems themselves.
So far I can tell that
01-list.t is definitely just a change of behavior. Before the API returned an empty string for an attribute value of an attribute which doesn't even exist and now it returns
undef. (That's actually a change for the better as it allows to distinguish an absent attribute from one with an empty value.) I'll create a PR for adapting the tests. Of course the other cases might be different.