action #53771

unstable test: t/ui/15-comments.t in line 102: "got: 'Demo wrote less than a minute ago (last edited less than a minute ago)'" expected: 'Demo wrote less than a minute ago'

Added by okurz 9 months ago. Updated about 1 month ago.

Status:BlockedStart date:03/07/2019
Priority:NormalDue date:
Assignee:okurz% Done:

0%

Category:Concrete Bugs
Target version:Current Sprint
Difficulty:
Duration:

Description

Observation

./t/ui/15-admin-workers.t ............ ok
        #   Failed test 'heading text'
        #   at ./t/ui/15-comments.t line 102.
        #          got: 'Demo wrote less than a minute ago (last edited less than a minute ago)'
        #     expected: 'Demo wrote less than a minute ago'
        # Looks like you failed 1 test of 6.
    #   Failed test 'add'
    #   at ./t/ui/15-comments.t line 132.
    # Looks like you failed 1 test of 4.
#   Failed test 'commenting on parent group overview'
#   at ./t/ui/15-comments.t line 404.
# Looks like you failed 1 test of 13.

Related issues

Related to openQA Project - action #53498: [sporadic] openQA CI tests fail on master in flaky/unstab... Resolved 24/06/2019

History

#1 Updated by okurz 9 months ago

  • Subject changed from unstable test: t/ui/15-admin-workers.t in line 102: "got: 'Demo wrote less than a minute ago (last edited less than a minute ago)'" expected: 'Demo wrote less than a minute ago' to unstable test: t/ui/15-comments.t in line 102: "got: 'Demo wrote less than a minute ago (last edited less than a minute ago)'" expected: 'Demo wrote less than a minute ago'
  • Status changed from New to In Progress
  • Assignee set to okurz

#2 Updated by okurz 9 months ago

  • Status changed from In Progress to Workable
  • Assignee deleted (okurz)
for i in {001..100} ;do echo "### $i" && prove t/ui/15-comments.t || break ; done

did not fail. I wonder if this is something related to the database content which is potentially altered by other parallel tests? I hope we can collect more data in the future.

#3 Updated by tinita 8 months ago

On my machine it always fails, but the failing test changes.

First run:

ok 9 - table properties shown
not ok 10 - still on 99963
#   Failed test 'still on 99963'
#   at t/ui/15-admin-workers.t line 157.
#                   'All Tests
# Job Groups
# Logged in as Demo
# Worker localhost:1
# Host: localhost
# Instance: 1
# Alive: yes
# Websocket connection: Offline
# Seen: about 2 hours ago
# Status: Working
# Properties
# Key Value
# JOBTOKEN token99963
# Previous jobs
# Show
# 10
# 25
# 50
# 100
# entries
# Test Result Finished
# opensuse-13.1-NET-x86_64-Build0091-kde@64bit not yet
# opensuse-Factory-staging_e-x86_64-Build87.5011-minimalx@32bit 0 about an hour ago
# Showing 1 to 2 of 2 entries
# Previous
# 1
# Next
# openQA is licensed GPL-2.0 - Version git-4.5.1528009330.e68ebe2b-bd128366'
#     doesn't match '(?^:Worker status\nJob: 99963)'

Running again:

[debug] 200 OK (0.033591s, 29.770/s)
ok 1 - on workers overview                                                     
ok 2 - localhost:1 do not show delete button                                                          
ok 3 - remotehost:1 do not show delete button     
ok 4 - foo do not show delete button                                                    
ok 5 - online_test do not show delete button                                              
ok 6 - offline worker show delete button                                                                           
ok 7 - localhost:1 shown                                                                                                            
ok 8 - on 99963                                                      
ok 9 - .popover gone                                     
ok 10 - remotehost:1 shown                                    
not ok 11 - working 99961                                                                 
#   Failed test 'working 99961'                                                                   
#   at t/ui/15-admin-workers.t line 123.                                       
#                   ''                                                                   
#     doesn't match '(?^:Worker status\nJob: 99961)'                 
ok 12 - .popover gone                                             
ok 13 - foo shown                                        
ok 14 - worker 5 is broken                                              
ok 15 - reason for brokenness shown                                                                   
1..15                                                                              
# Looks like you failed 1 test of 15.
not ok 6 - worker overview

Additional runs always result in one of the two.

#4 Updated by okurz 2 months ago

  • Related to action #53498: [sporadic] openQA CI tests fail on master in flaky/unstable t/ui/26-jobs_restart.t added

#5 Updated by okurz 2 months ago

  • Status changed from Workable to Feedback
  • Assignee set to okurz

#6 Updated by cdywan about 1 month ago

  • Target version set to Current Sprint

#7 Updated by okurz about 1 month ago

waiting for #59043 , need to understand if make variables are properly passed into the scope for "stability_test"

#8 Updated by okurz about 1 month ago

  • Status changed from Feedback to Blocked

#9 Updated by okurz about 1 month ago

One more unstable test in https://app.circleci.com/jobs/github/os-autoinst/openQA/16044

[10:04:18] t/ui/21-admin-needles.t .................... 17/? 
    #   Failed test 'getElementAttribute: stale element reference: element is not attached to the page document'
    #   at /home/squamata/project/t/ui/../lib/OpenQA/SeleniumTest.pm line 105.

    #   Failed test 'symlink needle last used module link is correct'
    #   at t/ui/21-admin-needles.t line 172.
    #                   '0'
    #     doesn't match '(?^:admin/needles/9/4)'
    # Looks like you failed 2 tests of 11.
[10:04:18] t/ui/21-admin-needles.t .................... 18/? 
#   Failed test 'dereference symlink when displaying needles info'
#   at t/ui/21-admin-needles.t line 181.

Also available in: Atom PDF