Project

General

Profile

Actions

action #122557

closed

[qe-core] test reliability: snapper_cleanup often times out

Added by dimstar almost 2 years ago. Updated almost 2 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
Bugs in existing tests
Start date:
Due date:
% Done:

0%

Estimated time:
Difficulty:

Description

Observation

The test is oftentimes fasting, rerunsc sometimes pass.

We seen to be running into s their waiting for the command to collect information

openQA test in scenario opensuse-Tumbleweed-DVD-x86_64-extra_tests_filesystem@64bit fails in
snapper_cleanup

Test suite description

Maintainer: QE Core

Filesystem related tests, for example snapper and btrfs features.

Reproducible

Fails since (at least) Build 20221230

Expected result

Last good: 20221229 (or more recent)

Further details

Always latest result in this scenario: latest

Actions #1

Updated by maritawerner almost 2 years ago

  • Subject changed from test reliability: snapper_cleanup often times out to [qe-core] test reliability: snapper_cleanup often times out
Actions #2

Updated by zluo almost 2 years ago

  • Status changed from New to In Progress
  • Assignee set to zluo
  • Start date deleted (2022-12-31)

take over and check

Actions #3

Updated by zluo almost 2 years ago

https://openqa.opensuse.org/tests/3030367#step/btrfs_autocompletion/10 failed already, reason is call trace:

https://openqa.opensuse.org/tests/3030367/logfile?filename=serial0.txt

[  243.176590][ T7778] ------------[ cut here ]------------
[  243.177307][ T7778] WARNING: CPU: 0 PID: 7778 at fs/btrfs/qgroup.c:2756 btrfs_qgroup_account_extents+0x1ae/0x260 [btrfs]
[  243.178611][ T7778] Modules linked in: dm_mirror dm_region_hash dm_log xfs algif_hash af_alg isofs loop af_packet nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 rfkill nf_tables nfnetlink qrtr intel_rapl_msr intel_rapl_common intel_uncore_frequency_common kvm_intel snd_hda_codec_generic ledtrig_audio snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec kvm ppdev snd_hda_core snd_hwdep snd_pcm snd_timer irqbypass virtio_net pcspkr net_failover snd failover soundcore i2c_piix4 parport_pc parport tiny_power_button button joydev fuse efi_pstore configfs dmi_sysfs ip_tables x_tables hid_generic usbhid crct10dif_pclmul crc32_pclmul polyval_clmulni polyval_generic gf128mul ghash_clmulni_intel sha512_ssse3 xhci_pci xhci_pci_renesas sr_mod xhci_hcd cdrom aesni_intel crypto_simd ata_generic usbcore bochs cryptd drm_vram_helper drm_ttm_helper virtio_blk
[  243.178660][ T7778]  virtio_scsi ttm ata_piix floppy serio_raw btrfs blake2b_generic libcrc32c crc32c_intel xor raid6_pq sg dm_multipath dm_mod scsi_dh_rdac scsi_dh_emc scsi_dh_alua qemu_fw_cfg virtio_rng
[  243.191699][ T7778] CPU: 0 PID: 7778 Comm: snapperd Not tainted 6.1.3-1-default #1 openSUSE Tumbleweed 94c09e59bead22c7d4264bd28427f55de54538c2
[  243.193186][ T7778] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.15.0-0-g2dd4b9b-rebuilt.opensuse.org 04/01/2014
[  243.194569][ T7778] RIP: 0010:btrfs_qgroup_account_extents+0x1ae/0x260 [btrfs]
[  243.195482][ T7778] Code: 85 c0 74 0f 48 8b 78 08 4c 89 fa 4c 89 ee e8 59 54 f5 ff 65 ff 0d 52 ed be 3f 0f 85 b8 fe ff ff 0f 1f 44 00 00 e9 ae fe ff ff <0f> 0b 49 8b 57 18 45 31 c9 4d 8d 47 38 31 c9 4c 89 ee e8 1b 71 ff
[  243.198145][ T7778] RSP: 0018:ffffb2a2c2713cb8 EFLAGS: 00010246
[  243.199075][ T7778] RAX: ffff9b7703c2d000 RBX: 0000000000000000 RCX: 000000001e6b0000
[  243.200195][ T7778] RDX: ffff9b7703c2d000 RSI: f0a9e0f90cef6b04 RDI: 0000000000000000
[  243.201383][ T7778] RBP: ffff9b770349b760 R08: ffffb2a2c2713bc8 R09: 0000000000000c40
[  243.202371][ T7778] R10: ffff9b7743ce9448 R11: 0000000000000001 R12: 0000000000000001
[  243.203191][ T7778] R13: ffff9b770740a000 R14: ffff9b7706545e38 R15: ffff9b7703c2d000
[  243.204019][ T7778] FS:  00007f305e0706c0(0000) GS:ffff9b775e400000(0000) knlGS:0000000000000000
[  243.205088][ T7778] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  243.205789][ T7778] CR2: 00007fad4119ee20 CR3: 0000000003fba004 CR4: 0000000000370ef0
[  243.206597][ T7778] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  243.207413][ T7778] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  243.208221][ T7778] Call Trace:
[  243.208579][ T7778]  <TASK>
[  243.208933][ T7778]  btrfs_commit_transaction+0x30c/0xb40 [btrfs db8db32c679239d3b334df0acddfa9a4f194b39b]
[  243.210071][ T7778]  ? start_transaction+0xc3/0x5b0 [btrfs db8db32c679239d3b334df0acddfa9a4f194b39b]
[  243.211411][ T7778]  btrfs_qgroup_rescan+0x42/0xc0 [btrfs db8db32c679239d3b334df0acddfa9a4f194b39b]
[  243.212907][ T7778]  btrfs_ioctl+0x1ab9/0x25c0 [btrfs db8db32c679239d3b334df0acddfa9a4f194b39b]
[  243.214298][ T7778]  ? call_rcu+0xd5/0xa10
[  243.214946][ T7778]  ? __seccomp_filter+0x319/0x4d0
[  243.215685][ T7778]  __x64_sys_ioctl+0x90/0xd0
[  243.216949][ T7778]  do_syscall_64+0x5b/0x80
[  243.217475][ T7778]  ? syscall_exit_to_user_mode+0x17/0x40
[  243.218050][ T7778]  ? do_syscall_64+0x67/0x80
[  243.218523][ T7778]  ? do_syscall_64+0x67/0x80
[  243.219002][ T7778]  ? syscall_exit_to_user_mode+0x17/0x40
[  243.219579][ T7778]  ? do_syscall_64+0x67/0x80
[  243.220050][ T7778]  entry_SYSCALL_64_after_hwframe+0x63/0xcd
[  243.220656][ T7778] RIP: 0033:0x7f305e70d9bf
[  243.221249][ T7778] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <89> c2 3d 00 f0 ff ff 77 18 48 8b 44 24 18 64 48 2b 04 25 28 00 00
[  243.224023][ T7778] RSP: 002b:00007f305e06f7e0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[  243.225418][ T7778] RAX: ffffffffffffffda RBX: 0000000000000007 RCX: 00007f305e70d9bf
[  243.226591][ T7778] RDX: 00007f305e06f840 RSI: 000000004040942c RDI: 0000000000000007
[  243.227863][ T7778] RBP: 00007f305e06f840 R08: 0000000000000000 R09: 0000000000000000
[  243.229862][ T7778] R10: 0000000000001000 R11: 0000000000000246 R12: 00005572b3bdccc0
[  243.231652][ T7778] R13: 00007f305e06fa30 R14: 00007f305e06fa60 R15: 00007f305e06fa1f
[  243.233484][ T7778]  </TASK>
[  243.234540][ T7778] ---[ end trace 0000000000000000 ]---
Actions #4

Updated by dimstar almost 2 years ago

btrfs_completion failure is https://progress.opensuse.org/issues/122809 (with a pending PR)

Actions #5

Updated by zluo almost 2 years ago

  • Status changed from In Progress to Resolved

https://openqa.opensuse.org/tests/3037772 this issue has been now resolved by above PR.

Actions #6

Updated by dimstar almost 2 years ago

zluo wrote:

https://openqa.opensuse.org/tests/3037772 this issue has been now resolved by above PR.

No - the above PR fixed the new btrfs_autocomplete issue that arose much later than the instability of the test.

This has been failing on and off for much longer and needs attention

Actions #7

Updated by dimstar almost 2 years ago

  • Status changed from Resolved to Workable
Actions #8

Updated by zluo almost 2 years ago

  • Status changed from Workable to In Progress
Actions #9

Updated by zluo almost 2 years ago

  • Tags set to bugbusters
  • Target version set to QE-Core: Ready
Actions #10

Updated by zluo almost 2 years ago

  • Status changed from In Progress to Resolved
Actions

Also available in: Atom PDF