Project

General

Profile

action #16380 ยป wtf.txt

Kernel log from worker host affected by this (jobs 79745 and 79754) around the time workers stopped checking in - AdamWill, 2017-03-14 20:12

 
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10023ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 13184 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59ced77780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59ced77808 ffffffffbe1cc4ba 024000c0ced777a0 ffffffffbec50c88
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59ced777a8 ffff952400000010 ffffae59ced77818 ffffae59ced777c8
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe02fdf9>] ? sched_clock+0x9/0x10
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6e44e9>] datagram_poll+0x29/0x100
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe76b6c9>] udp_poll+0x19/0x90
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d2580>] sock_poll+0x80/0xa0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d83ac>] ? __release_sock+0x9c/0xf0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d848c>] ? release_sock+0x8c/0xa0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: active_anon:5416590 inactive_anon:604564 isolated_anon:980
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12142708kB inactive_anon:1449936kB active_file:28146220kB inactive_file:6548800kB unevictable:23400kB isolated(anon):1772kB isolated(file):1016kB mapped:124260kB dirty:6556972kB writeback:2352kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 256kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9523652kB inactive_anon:968320kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB isolated(anon):2148kB isolated(file):368kB mapped:67840kB dirty:2896056kB writeback:1120kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183952kB min:2732kB low:5732kB high:8732kB active_anon:1891120kB inactive_anon:35836kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2020kB kernel_stack:256kB pagetables:780kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42016kB min:42256kB low:88648kB high:135040kB active_anon:10251588kB inactive_anon:1414100kB active_file:27290764kB inactive_file:6540864kB unevictable:23392kB writepending:6551388kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140788kB kernel_stack:11080kB pagetables:75540kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44688kB min:45104kB low:94624kB high:144144kB active_anon:9523652kB inactive_anon:968320kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB writepending:2897176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76096kB kernel_stack:6120kB pagetables:40796kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3066*4kB (UME) 3321*8kB (UME) 1828*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183984kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1284*4kB (UME) 1636*8kB (UME) 1124*16kB (UMEH) 196*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42800kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1471*4kB (UME) 988*8kB (UME) 769*16kB (UMEH) 409*32kB (UMEH) 80*64kB (UMEH) 0*128kB 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45324kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 18238526 total pagecache pages
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 1314 pages in swap cache
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1065298, delete 1063984, find 2675730/2979213
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Free swap = 8188076kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10404ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: CPU: 21 PID: 18924 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59cced38f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59cced3980 ffffffffbe1cc4ba 024000c0cced3918 ffffffffbec50c88
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59cced3920 ffff953000000010 ffffae59cced3990 ffffae59cced3940
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: active_anon:5416523 inactive_anon:604628 isolated_anon:983
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12142704kB inactive_anon:1449928kB active_file:28146220kB inactive_file:6549056kB unevictable:23400kB isolated(anon):1784kB isolated(file):760kB mapped:124260kB dirty:6556972kB writeback:2360kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 256kB writeback_tmp:0kB unstable:0kB pages_scanned:448 all_unreclaimable? no
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9523388kB inactive_anon:968584kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB isolated(anon):2148kB isolated(file):368kB mapped:67840kB dirty:2896056kB writeback:1120kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:608 all_unreclaimable? no
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1891120kB inactive_anon:35836kB active_file:855456kB inactive_file:7552kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2020kB kernel_stack:256kB pagetables:780kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42168kB min:42256kB low:88648kB high:135040kB active_anon:10251584kB inactive_anon:1414092kB active_file:27290764kB inactive_file:6541120kB unevictable:23392kB writepending:6551396kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140788kB kernel_stack:11080kB pagetables:75540kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44852kB min:45104kB low:94624kB high:144144kB active_anon:9523388kB inactive_anon:968584kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB writepending:2897176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76096kB kernel_stack:6120kB pagetables:40796kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3066*4kB (UME) 3321*8kB (UME) 1828*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183984kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1276*4kB (UME) 1636*8kB (UME) 1124*16kB (UMEH) 196*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42768kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1496*4kB (UME) 988*8kB (UME) 769*16kB (UMEH) 409*32kB (UMEH) 80*64kB (UMEH) 0*128kB 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45424kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 18238528 total pagecache pages
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 1316 pages in swap cache
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1065300, delete 1063984, find 2675731/2979215
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Free swap = 8188068kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:21:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: reader#1: page allocation stalls for 13921ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: CPU: 22 PID: 2487 Comm: reader#1 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: ffffae59cddbb9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: ffffae59cddbba50 ffffffffbe1cc4ba 024200cacddbb9e8 ffffffffbec50c88
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: ffffae59cddbb9f0 ffff952400000010 ffffae59cddbba60 ffffae59cddbba10
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe272249>] ? dput+0xd9/0x260
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe28f4c7>] ? do_statfs_native+0xa7/0xd0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: active_anon:5419918 inactive_anon:600157 isolated_anon:886
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12151060kB inactive_anon:1439184kB active_file:28146312kB inactive_file:6548092kB unevictable:23400kB isolated(anon):3112kB isolated(file):632kB mapped:124216kB dirty:6557004kB writeback:1236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 200kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9528612kB inactive_anon:961444kB active_file:35339696kB inactive_file:2895048kB unevictable:141172kB isolated(anon):432kB isolated(file):240kB mapped:67896kB dirty:2895812kB writeback:1064kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:768 all_unreclaimable? no
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1891504kB inactive_anon:35448kB active_file:855456kB inactive_file:7776kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2016kB kernel_stack:256kB pagetables:784kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42172kB min:42256kB low:88648kB high:135040kB active_anon:10259556kB inactive_anon:1403736kB active_file:27290856kB inactive_file:6540152kB unevictable:23392kB writepending:6550300kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140680kB kernel_stack:10536kB pagetables:75452kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9528612kB inactive_anon:961444kB active_file:35339696kB inactive_file:2895048kB unevictable:141172kB writepending:2896876kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76140kB kernel_stack:5992kB pagetables:40756kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184012kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1408*4kB (UME) 1695*8kB (UME) 1123*16kB (UMEH) 198*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43816kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1552*4kB (UME) 1087*8kB (UME) 777*16kB (UMEH) 411*32kB (UMEH) 81*64kB (UMEH) 2*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46952kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 18238501 total pagecache pages
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 1695 pages in swap cache
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1067280, delete 1065585, find 2675818/2979365
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Free swap = 8182020kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:21:57 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:22:19 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 21494ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 6 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe262729>] pipe_write+0x1e9/0x410
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442964 inactive_anon:578700 isolated_anon:711
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240400kB inactive_anon:1356592kB active_file:28146696kB inactive_file:6544012kB unevictable:23400kB isolated(anon):2344kB isolated(file):888kB mapped:124248kB dirty:6553092kB writeback:884kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531456kB inactive_anon:958208kB active_file:35339704kB inactive_file:2892108kB unevictable:141172kB isolated(anon):500kB isolated(file):496kB mapped:67916kB dirty:2894744kB writeback:860kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:641 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7780kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42156kB min:42256kB low:88648kB high:135040kB active_anon:10345604kB inactive_anon:1324444kB active_file:27291240kB inactive_file:6536076kB unevictable:23392kB writepending:6546040kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9531456kB inactive_anon:958208kB active_file:35339704kB inactive_file:2892108kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76120kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1591*4kB (UME) 1846*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44364kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 567*4kB (UME) 1343*8kB (UME) 848*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45428kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237265 total pagecache pages
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1765 pages in swap cache
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070652, delete 1068887, find 2677059/2981593
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap = 8179632kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 15381ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 23 PID: 19713 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cf71bb60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cf71bbe8 ffffffffbe1cc4ba 024280cacf71bb80 ffffffffbec50c88
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cf71bb88 ffff953000000010 ffffae59cf71bbf8 ffffae59cf71bba8
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe126aa9>] ? futex_wait+0xf9/0x260
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442935 inactive_anon:578836 isolated_anon:679
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240448kB inactive_anon:1356932kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2344kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:884kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:41 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958412kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):372kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:892kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7780kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345652kB inactive_anon:1324780kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546040kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958412kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895600kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1639*4kB (UME) 1848*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44572kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 616*4kB (UME) 1344*8kB (UME) 848*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45632kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237255 total pagecache pages
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1760 pages in swap cache
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070662, delete 1068902, find 2677061/2981597
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap = 8179600kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 11032ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 19618 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59ce94f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59ce94f980 ffffffffbe1cc4ba 024000c0ce94f918 ffffffffbec50c88
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59ce94f920 ffff952400000010 ffffae59ce94f990 ffffae59ce94f940
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 23637ms, order:0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: , mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0ce150>] ? wake_up_q+0x80/0x80
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe258f67>] ? __vfs_write+0x37/0x160
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 9 PID: 20329 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59e164b838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442947 inactive_anon:578811 isolated_anon:679
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59e164b8c0 ffffffffbe1cc4ba 0342004ae164b858 ffffffffbec50c88
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59e164b860 ffff952400000010 ffffae59e164b8d0 ffffae59e164b880
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240496kB inactive_anon:1356960kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2216kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:1039 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):500kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe290e01>] ? alloc_buffer_head+0x21/0x60
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe290e01>] ? alloc_buffer_head+0x21/0x60
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240 48240 48240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c0e1c>] ? unlock_page+0x4c/0x60
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7772kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308 45308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345700kB inactive_anon:1324808kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546052kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe230928>] ? __kmalloc+0x168/0x1f0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe254f6f>] ? __check_object_size+0xff/0x1d6
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe258ea6>] do_iter_readv_writev+0xb6/0x140
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259b2e>] do_readv_writev+0x19e/0x240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e3d0>] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs]
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0cd159>] ? check_preempt_curr+0x79/0x90
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0cef6a>] ? wake_up_new_task+0x14a/0x1f0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0af18b>] ? recalc_sigpending+0x1b/0x50
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259e1c>] vfs_writev+0x3c/0x50
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259fd2>] do_pwritev+0xb2/0xd0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25b0a1>] SyS_pwritev+0x11/0x20
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 1*128kB (U) 1*256kB (U)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442947 inactive_anon:578811 isolated_anon:679
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240496kB inactive_anon:1356960kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2216kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:1679 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):500kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:1792 all_unreclaimable? no
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4096kB = 183988kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1677*4kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1855*8kB (UME)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1128*16kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMEH) 156*32kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMH)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7772kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*64kB (H)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*128kB (H) 0*256kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*1024kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345700kB inactive_anon:1324808kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546052kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: = 44780kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 719*4kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1351*8kB (UME)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 849*16kB (UMEH)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 377*32kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 84*64kB (UMEH)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 3*128kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*256kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (H) 0*2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: DMA:
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: = 46116kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*8kB (U)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237241 total pagecache pages
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*16kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1737 pages in swap cache
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070721, delete 1068984, find 2677062/2981599
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap = 8179488kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 0*32kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 2*64kB (U)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 1*256kB (U)
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1677*4kB (UME) 1855*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44780kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 719*4kB (UME) 1351*8kB (UME) 849*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46116kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237241 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1737 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070721, delete 1068984, find 2677062/2981599
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8179488kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: in:imjournal: page allocation stalls for 17228ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 2006 Comm: in:imjournal Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc878f0 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc87978 ffffffffbe1cc4ba 0342004acdc87910 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc87918 ffff953000000010 ffffae59cdc87988 ffffae59cdc87938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443119 inactive_anon:577373 isolated_anon:790
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241144kB inactive_anon:1353008kB active_file:28146764kB inactive_file:6545028kB unevictable:23400kB isolated(anon):2696kB isolated(file):504kB mapped:124216kB dirty:6555064kB writeback:640kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:768 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531332kB inactive_anon:956484kB active_file:35339692kB inactive_file:2892788kB unevictable:141172kB isolated(anon):464kB isolated(file):1008kB mapped:67916kB dirty:2895500kB writeback:612kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:640 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894788kB inactive_anon:32152kB active_file:855456kB inactive_file:7808kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42156kB min:42256kB low:88648kB high:135040kB active_anon:10346356kB inactive_anon:1320856kB active_file:27291308kB inactive_file:6537092kB unevictable:23392kB writepending:6547768kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44736kB min:45104kB low:94624kB high:144144kB active_anon:9531332kB inactive_anon:956484kB active_file:35339692kB inactive_file:2892788kB unevictable:141172kB writepending:2896112kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1026*4kB (UME) 1996*8kB (UME) 1143*16kB (UMEH) 160*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43672kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 590*4kB (UME) 1436*8kB (UME) 850*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46296kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237500 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1580 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1071922, delete 1070342, find 2677186/2981768
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8178536kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 14411ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 19577 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cff6f8f0 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cff6f978 ffffffffbe1cc4ba 0342004acff6f910 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cff6f918 ffff953000000010 ffffae59cff6f988 ffffae59cff6f938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443139 inactive_anon:577355 isolated_anon:646
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241248kB inactive_anon:1353192kB active_file:28146764kB inactive_file:6545728kB unevictable:23400kB isolated(anon):2120kB isolated(file):1144kB mapped:124216kB dirty:6553772kB writeback:2900kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:1024 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531308kB inactive_anon:956228kB active_file:35339704kB inactive_file:2893392kB unevictable:141172kB isolated(anon):464kB isolated(file):1264kB mapped:67916kB dirty:2895648kB writeback:1212kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:1056 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894792kB inactive_anon:32152kB active_file:855456kB inactive_file:7936kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42144kB min:42256kB low:88648kB high:135040kB active_anon:10346456kB inactive_anon:1321040kB active_file:27291308kB inactive_file:6537792kB unevictable:23392kB writepending:6548736kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9531308kB inactive_anon:956228kB active_file:35339704kB inactive_file:2893392kB unevictable:141172kB writepending:2896860kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 913*4kB (UME) 2003*8kB (UME) 1146*16kB (UMEH) 161*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43356kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 492*4kB (UME) 1449*8kB (UME) 852*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46040kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237942 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1533 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1071983, delete 1070450, find 2677186/2981769
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8178292kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 10849ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 18908 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683be0 ffffffffbe1cc4ba 025200c2e9683b78 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b80 ffff953000000010 ffffae59e9683bf0 ffffae59e9683ba0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe262729>] pipe_write+0x1e9/0x410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443256 inactive_anon:577228 isolated_anon:517
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241248kB inactive_anon:1353196kB active_file:28146764kB inactive_file:6545728kB unevictable:23400kB isolated(anon):1604kB isolated(file):1144kB mapped:124216kB dirty:6553772kB writeback:4kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:128 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531776kB inactive_anon:955716kB active_file:35339704kB inactive_file:2893212kB unevictable:141172kB isolated(anon):464kB isolated(file):1136kB mapped:67916kB dirty:2895648kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894792kB inactive_anon:32152kB active_file:855456kB inactive_file:7936kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42124kB min:42256kB low:88648kB high:135040kB active_anon:10346456kB inactive_anon:1321044kB active_file:27291308kB inactive_file:6537792kB unevictable:23392kB writepending:6545840kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:116kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44736kB min:45104kB low:94624kB high:144144kB active_anon:9531776kB inactive_anon:955716kB active_file:35339704kB inactive_file:2893212kB unevictable:141172kB writepending:2895412kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183968kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1202*4kB (UME) 2093*8kB (UME) 1152*16kB (UMEH) 167*32kB (UMH) 4*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45712kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 739*4kB (UME) 1464*8kB (UME) 867*16kB (UMEH) 386*32kB (UMEH) 87*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47868kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237868 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1434 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1072193, delete 1070759, find 2677190/2981777
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8177772kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 33973ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 20329 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e164b838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e164b8c0 ffffffffbe1cc4ba 0342004ae164b858 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e164b860 ffff952400000010 ffffae59e164b8d0 ffffae59e164b880
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe290e01>] ? alloc_buffer_head+0x21/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c0e1c>] ? unlock_page+0x4c/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe230928>] ? __kmalloc+0x168/0x1f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe254f6f>] ? __check_object_size+0xff/0x1d6
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe258ea6>] do_iter_readv_writev+0xb6/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259b2e>] do_readv_writev+0x19e/0x240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e3d0>] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0cd159>] ? check_preempt_curr+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0cef6a>] ? wake_up_new_task+0x14a/0x1f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0af18b>] ? recalc_sigpending+0x1b/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259e1c>] vfs_writev+0x3c/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259fd2>] do_pwritev+0xb2/0xd0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25b0a1>] SyS_pwritev+0x11/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543848kB unevictable:23400kB isolated(anon):2156kB isolated(file):1144kB mapped:124220kB dirty:6554556kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2895424kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1224 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7512kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42040kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535916kB unevictable:23392kB writepending:6545716kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1822*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184004kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1186*4kB (UME) 1837*8kB (UME) 1170*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44112kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 457*4kB (UME) 1414*8kB (UME) 870*16kB (UMEH) 363*32kB (UMEH) 92*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45972kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1762 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073714, delete 1071951, find 2677693/2982671
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176484kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 13952ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 19443 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb47780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb47808 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb477a8 ffff953000000010 ffffae59cdb47818 ffffae59cdb477c8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0dae69>] ? dequeue_entity+0x259/0xba0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6e44e9>] datagram_poll+0x29/0x100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe76b6c9>] udp_poll+0x19/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d2580>] sock_poll+0x80/0xa0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22fd21>] ? __slab_free+0xa1/0x2a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:568 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42040kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6545716kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1822*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184004kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1290*4kB (UME) 1841*8kB (UME) 1173*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44608kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 597*4kB (UME) 1427*8kB (UME) 873*16kB (UMEH) 365*32kB (UMEH) 92*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46748kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1653 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073767, delete 1072114, find 2677693/2982671
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176400kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 14016ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 17 PID: 17998 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfa3b60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfa3be8 ffffffffbe1cc4ba 024280cacdfa3b80 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfa3b88 ffff953000000010 ffffae59cdfa3bf8 ffffae59cdfa3ba8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe02fdf9>] ? sched_clock+0x9/0x10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:288 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1289*4kB (UME) 1850*8kB (UME) 1174*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44692kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 705*4kB (UME) 1441*8kB (UME) 873*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47484kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1598 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073892, delete 1072294, find 2677694/2982675
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176156kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 11573ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 8 PID: 17514 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf33fb60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf33fbe8 ffffffffbe1cc4ba 024280cacf33fb80 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf33fb88 ffff952400000010 ffffae59cf33fbf8 ffffae59cf33fba8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe126aa9>] ? futex_wait+0xf9/0x260
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:224 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1291*4kB (UME) 1850*8kB (UME) 1174*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44700kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 709*4kB (UME) 1441*8kB (UME) 873*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47500kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1598 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073892, delete 1072294, find 2677694/2982675
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176156kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 35229ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 24 PID: 20284 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cfa53838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cfa538c0 ffffffffbe1cc4ba 0342004acfa53858 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cfa53860 ffff953000000010 ffffae59cfa538d0 ffffae59cfa53880
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd71c>] ? handle_mm_fault+0xb9c/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe230928>] ? __kmalloc+0x168/0x1f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe254f6f>] ? __check_object_size+0xff/0x1d6
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe258ea6>] do_iter_readv_writev+0xb6/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259b2e>] do_readv_writev+0x19e/0x240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1285ed>] ? do_futex+0x2dd/0xaf0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc039e3d0>] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259e1c>] vfs_writev+0x3c/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259fd2>] do_pwritev+0xb2/0xd0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25b0a1>] SyS_pwritev+0x11/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:972 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:12kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894140kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:36kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1326*4kB (UME) 1862*8kB (UME) 1176*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44968kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 794*4kB (UME) 1450*8kB (UME) 874*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47928kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1609 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073924, delete 1072315, find 2677694/2982675
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176028kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 32043ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe262729>] pipe_write+0x1e9/0x410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892468kB unevictable:141172kB isolated(anon):532kB isolated(file):624kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:130 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892468kB unevictable:141172kB writepending:2894140kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1441*4kB (UME) 1869*8kB (UME) 1176*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45484kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 911*4kB (UME) 1464*8kB (UME) 883*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 48684kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1532 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073941, delete 1072409, find 2677694/2982677
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175960kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 10497ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 29 PID: 13179 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9f7be0 ffffffffbe1cc4ba 025200c2ce9f7b78 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9f7b80 ffff952400000010 ffffae59ce9f7bf0 ffffae59ce9f7ba0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe262729>] pipe_write+0x1e9/0x410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB isolated(anon):532kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1664 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6543544kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45092kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB writepending:2893416kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1533*4kB (UME) 1884*8kB (UME) 1179*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46020kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1052*4kB (UME) 1494*8kB (UME) 889*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 49584kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1503 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074084, delete 1072581, find 2677694/2982677
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175772kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10585ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 10 PID: 19621 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f980 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f920 ffff952400000010 ffffae59cda2f990 ffffae59cda2f940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81ae80>] ? rwsem_down_write_failed_killable+0x1b0/0x3e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB isolated(anon):532kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:528 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6543544kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45092kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB writepending:2893416kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1536*4kB (UME) 1884*8kB (UME) 1179*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46032kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1054*4kB (UME) 1494*8kB (UME) 889*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 49592kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1503 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074084, delete 1072581, find 2677694/2982677
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175772kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 35202ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe262729>] pipe_write+0x1e9/0x410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444748 inactive_anon:578108 isolated_anon:49
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244552kB inactive_anon:1355172kB active_file:28146776kB inactive_file:6537248kB unevictable:23400kB isolated(anon):136kB isolated(file):2808kB mapped:124184kB dirty:6549788kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:128 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534440kB inactive_anon:957260kB active_file:35339712kB inactive_file:2889332kB unevictable:141172kB isolated(anon):60kB isolated(file):368kB mapped:67920kB dirty:2890688kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183932kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32116kB active_file:855456kB inactive_file:7360kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2080kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41776kB min:42256kB low:88648kB high:135040kB active_anon:10349752kB inactive_anon:1323024kB active_file:27291320kB inactive_file:6529312kB unevictable:23392kB writepending:6541244kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375932kB slab_unreclaimable:140816kB kernel_stack:10788kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44688kB min:45104kB low:94624kB high:144144kB active_anon:9534440kB inactive_anon:957260kB active_file:35339712kB inactive_file:2889332kB unevictable:141172kB writepending:2890284kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277088kB slab_unreclaimable:76220kB kernel_stack:6728kB pagetables:41004kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183904kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1117*4kB (UME) 2071*8kB (UME) 1219*16kB (UMEH) 154*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46108kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 580*4kB (UME) 1148*8kB (UME) 975*16kB (UMEH) 405*32kB (UMEH) 96*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47616kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235519 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1313 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074366, delete 1073053, find 2677773/2982822
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175132kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 10401ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 2520 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16fa50 ffffffffbe1cc4ba 024200cace16f9e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9f0 ffff952400000010 ffffae59ce16fa60 ffffae59ce16fa10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe21412a>] swapin_readahead+0x12a/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443745 inactive_anon:579651 isolated_anon:36
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240860kB inactive_anon:1360408kB active_file:28146776kB inactive_file:6538276kB unevictable:23400kB isolated(anon):128kB isolated(file):3192kB mapped:124184kB dirty:6544508kB writeback:1840kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534120kB inactive_anon:958196kB active_file:35339708kB inactive_file:2886176kB unevictable:141172kB isolated(anon):16kB isolated(file):368kB mapped:67920kB dirty:2882980kB writeback:3388kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:513 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183920kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32148kB active_file:855456kB inactive_file:7584kB unevictable:8kB writepending:7920kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2112kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42080kB min:42256kB low:88648kB high:135040kB active_anon:10346060kB inactive_anon:1328260kB active_file:27291320kB inactive_file:6530356kB unevictable:23392kB writepending:6538428kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375928kB slab_unreclaimable:140648kB kernel_stack:10772kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44732kB min:45104kB low:94624kB high:144144kB active_anon:9534120kB inactive_anon:958196kB active_file:35339708kB inactive_file:2886176kB unevictable:141172kB writepending:2887092kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277088kB slab_unreclaimable:76008kB kernel_stack:6744kB pagetables:41004kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3069*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183932kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1332*4kB (UME) 2009*8kB (UME) 1215*16kB (UMEH) 154*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46408kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 558*4kB (UME) 1132*8kB (UME) 1004*16kB (UMEH) 407*32kB (UMEH) 96*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47928kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234465 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1344 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074488, delete 1073144, find 2677899/2983053
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175276kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: warn_alloc: 1 callbacks suppressed
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 12995ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 0 PID: 19619 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb67690 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb67718 ffffffffbe1cc4ba 024280cacdb676b0 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb676b8 ffff952400000010 ffffae59cdb67728 ffffae59cdb676d8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1f7691>] __get_user_pages+0x171/0x730
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1f805f>] get_user_pages+0x4f/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076a030>] __gfn_to_pfn_memslot+0x120/0x420 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0787846>] try_async_pf+0x66/0x230 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076c1ba>] ? kvm_host_page_size+0x8a/0xa0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790d20>] tdp_page_fault+0x130/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443218 inactive_anon:581444 isolated_anon:98
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12239420kB inactive_anon:1363496kB active_file:28146964kB inactive_file:6540428kB unevictable:23400kB isolated(anon):136kB isolated(file):248kB mapped:124184kB dirty:6551296kB writeback:28kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533452kB inactive_anon:962280kB active_file:35339912kB inactive_file:2887240kB unevictable:141172kB isolated(anon):256kB isolated(file):240kB mapped:67916kB dirty:2889532kB writeback:1080kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 148kB writeback_tmp:0kB unstable:0kB pages_scanned:674 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183936kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32148kB active_file:855456kB inactive_file:7792kB unevictable:8kB writepending:7920kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2108kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41904kB min:42256kB low:88648kB high:135040kB active_anon:10344620kB inactive_anon:1331348kB active_file:27291508kB inactive_file:6532508kB unevictable:23392kB writepending:6543404kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375924kB slab_unreclaimable:140824kB kernel_stack:10664kB pagetables:75424kB bounce:0kB free_pcp:36kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44300kB min:45104kB low:94624kB high:144144kB active_anon:9533452kB inactive_anon:962280kB active_file:35339912kB inactive_file:2887240kB unevictable:141172kB writepending:2890612kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277084kB slab_unreclaimable:76524kB kernel_stack:6600kB pagetables:40904kB bounce:0kB free_pcp:136kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3070*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183952kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1039*4kB (UME) 1813*8kB (UME) 1145*16kB (UMEH) 168*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42996kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 803*4kB (UME) 892*8kB (UME) 862*16kB (UMEH) 433*32kB (UMEH) 113*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46636kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234194 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1112 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074739, delete 1073627, find 2678054/2983360
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175196kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#1: page allocation stalls for 11515ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 2482 Comm: writer#1 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdcc79c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdcc7a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdcc79f0 ffff952400000010 ffffae59cdcc7a60 ffffae59cdcc7a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4097>] ? SYSC_sendto+0x157/0x190
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443734 inactive_anon:580423 isolated_anon:166
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12239472kB inactive_anon:1362784kB active_file:28147060kB inactive_file:6539600kB unevictable:23400kB isolated(anon):264kB isolated(file):2040kB mapped:124184kB dirty:6550600kB writeback:1520kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:7904 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535464kB inactive_anon:958908kB active_file:35339968kB inactive_file:2889200kB unevictable:141172kB isolated(anon):400kB isolated(file):112kB mapped:67916kB dirty:2891828kB writeback:436kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32156kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7928kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2012kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42212kB min:42256kB low:88648kB high:135040kB active_anon:10344672kB inactive_anon:1330628kB active_file:27291604kB inactive_file:6531676kB unevictable:23392kB writepending:6544192kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140692kB kernel_stack:10616kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44760kB min:45104kB low:94624kB high:144144kB active_anon:9535464kB inactive_anon:958908kB active_file:35339968kB inactive_file:2889200kB unevictable:141172kB writepending:2892264kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277064kB slab_unreclaimable:76088kB kernel_stack:6488kB pagetables:40892kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1455*4kB (UME) 1819*8kB (UME) 1127*16kB (UMEH) 158*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43844kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 840*4kB (UME) 978*8kB (UME) 771*16kB (UMEH) 387*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46400kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235423 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1489 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076439, delete 1074950, find 2678314/2983846
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170360kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: NetworkManager: page allocation stalls for 12047ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 1975 Comm: NetworkManager Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0e79c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0e7a50 ffffffffbe1cc4ba 024200cace0e79e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0e79f0 ffff953000000010 ffffae59ce0e7a60 ffffae59ce0e7a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444325 inactive_anon:580396 isolated_anon:70
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240912kB inactive_anon:1362672kB active_file:28147060kB inactive_file:6539752kB unevictable:23400kB isolated(anon):264kB isolated(file):1144kB mapped:124184kB dirty:6550824kB writeback:204kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:64 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536388kB inactive_anon:958912kB active_file:35339968kB inactive_file:2889512kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891684kB writeback:624kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7736kB unevictable:8kB writepending:7928kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2012kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42024kB min:42256kB low:88648kB high:135040kB active_anon:10346112kB inactive_anon:1330520kB active_file:27291604kB inactive_file:6531824kB unevictable:23392kB writepending:6543100kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140628kB kernel_stack:10616kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44732kB min:45104kB low:94624kB high:144144kB active_anon:9536388kB inactive_anon:958912kB active_file:35339968kB inactive_file:2889512kB unevictable:141172kB writepending:2892308kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76064kB kernel_stack:6488kB pagetables:40892kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184012kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1359*4kB (UME) 1819*8kB (UME) 1127*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43428kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 732*4kB (UME) 938*8kB (UME) 771*16kB (UMEH) 387*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45648kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235203 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1476 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076446, delete 1074970, find 2678315/2983848
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170336kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 12777ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 31 PID: 17985 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc1f970 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc1f9f8 ffffffffbe1cc4ba 024000c0cdc1f990 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc1f998 ffff953000000010 ffffae59cdc1fa08 ffffae59cdc1f9b8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0c97a8>] ? finish_task_switch+0x128/0x240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d7900>] skb_page_frag_refill+0xd0/0x120
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d81dd>] sk_page_frag_refill+0x1d/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe74ad87>] tcp_sendmsg+0x207/0xc00
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe7778d5>] inet_sendmsg+0x65/0xa0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d3a38>] sock_sendmsg+0x38/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4542>] ___sys_sendmsg+0x2c2/0x2d0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc2a1>] ? zone_watermark_ok+0x21/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd71c>] ? handle_mm_fault+0xb9c/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4097>] ? SYSC_sendto+0x157/0x190
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe278b35>] ? __fget_light+0x25/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4e94>] __sys_sendmsg+0x54/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4ee2>] SyS_sendmsg+0x12/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540380kB unevictable:23400kB isolated(anon):284kB isolated(file):504kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892984kB writeback:32kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:130 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42092kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532448kB unevictable:23392kB writepending:6543404kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2893016kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75988kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:56kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1237*4kB (UME) 1833*8kB (UME) 1135*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43180kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 790*4kB (UME) 945*8kB (UME) 771*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45744kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1232 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076484, delete 1075252, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170184kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 12440ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 18908 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683be0 ffffffffbe1cc4ba 025200c2e9683b78 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b80 ffff953000000010 ffffae59e9683bf0 ffffae59e9683ba0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe262729>] pipe_write+0x1e9/0x410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:254 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892260kB writeback:652kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1348*4kB (UME) 1834*8kB (UME) 1137*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43664kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 842*4kB (UME) 945*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45936kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1243 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075252, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: reader#4: page allocation stalls for 13135ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 2490 Comm: reader#4 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdf439c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdf43a50 ffffffffbe1cc4ba 024200cacdf439e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdf439f0 ffff952400000010 ffffae59cdf43a60 ffffae59cdf43a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:576 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892260kB writeback:652kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:388 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1358*4kB (UME) 1834*8kB (UME) 1137*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43704kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 849*4kB (UME) 945*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45964kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1243 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075252, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: systemd-journal: page allocation stalls for 10290ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 17 PID: 1649 Comm: systemd-journal Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd937a50 ffffffffbe1cc4ba 024200cacd9379e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379f0 ffff953000000010 ffffae59cd937a60 ffffae59cd937a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe003cdd>] ? do_syscall_64+0x12d/0x180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:416 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:448 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1482*4kB (UME) 1840*8kB (UME) 1138*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44264kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 884*4kB (UME) 946*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46112kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 17329ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 19453 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3338f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce333980 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce333920 ffff953000000010 ffffae59ce333990 ffffae59ce333940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: iscsid: page allocation stalls for 10440ms, order:0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 16 PID: 2041 Comm: iscsid Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839c8 ffffffffbe3f40bd
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce283a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839f0 ffff952400000010 ffffae59ce283a60 ffffae59ce283a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:48942 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81b687>] ? do_nanosleep+0x97/0xf0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1024 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:49454 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*2048kB (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 1829*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 164*128kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB (UH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 4*64kB (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 946*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 770*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 7*128kB (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 16465ms, order:0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 0 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#3:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 10648ms, order:0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879c8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe3f40bd
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UH) 4*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe1cc4ba
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 024200ca00000000
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 0*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffff952400000010
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB (UME) 946*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe817f26>] ? schedule+0x36/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81b366>] ? schedule_timeout+0x226/0x3f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 770*16kB (UEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe11ad81>] ? ktime_get+0x41/0xb0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB (UMEH) 7*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 6 PID: 2484 Comm: writer#3 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2f9c8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe3f40bd
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:2191 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2fa50 ffffffffbe1cc4ba
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:51118 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 024200ca00000000
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2f9f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffff952400000010
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 2931 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2fa60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2fa10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4097>] ? SYSC_sendto+0x157/0x190
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:3087 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:51630 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 2931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB (UH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 4*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 0*2048kB 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 946*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 770*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 7*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1483*4kB (UME) 1840*8kB (UME) 1138*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44268kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 884*4kB (UME) 946*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46112kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: warn_alloc: 6 callbacks suppressed
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 11765ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 21 PID: 19719 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9ff780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9ff808 ffffffffbe1cc4ba 024000c0f255aa80 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9ff7a8 0000000000000010 ffffae59cd9ff818 ffffae59cd9ff7c8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0d5e33>] ? update_load_avg+0x73/0x360
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6e44e9>] datagram_poll+0x29/0x100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe76b6c9>] udp_poll+0x19/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d2580>] sock_poll+0x80/0xa0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0032a0>] ? exit_to_usermode_loop+0x90/0xb0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5445249 inactive_anon:578063 isolated_anon:580
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244924kB inactive_anon:1357944kB active_file:28147060kB inactive_file:6538048kB unevictable:23400kB isolated(anon):1304kB isolated(file):2680kB mapped:124184kB dirty:6551180kB writeback:472kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:12523832 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536072kB inactive_anon:954308kB active_file:35339968kB inactive_file:2890944kB unevictable:141172kB isolated(anon):1016kB isolated(file):112kB mapped:67916kB dirty:2892684kB writeback:1068kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1094420 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183872kB min:2732kB low:5732kB high:8732kB active_anon:1894804kB inactive_anon:32152kB active_file:855456kB inactive_file:7848kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2016kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:124kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42560kB min:42256kB low:88648kB high:135040kB active_anon:10350120kB inactive_anon:1325792kB active_file:27291604kB inactive_file:6530108kB unevictable:23392kB writepending:6543712kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:660kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:46176kB min:45104kB low:94624kB high:144144kB active_anon:9536072kB inactive_anon:954308kB active_file:35339968kB inactive_file:2890944kB unevictable:141172kB writepending:2893752kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75988kB kernel_stack:6232kB pagetables:40852kB bounce:0kB free_pcp:1252kB local_pcp:12kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3030*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183872kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1296*4kB (UME) 1820*8kB (UME) 1136*16kB (UMEH) 141*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42560kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 843*4kB (UME) 965*8kB (UME) 778*16kB (UMEH) 385*32kB (UMEH) 123*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46420kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234860 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 826 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076952, delete 1076126, find 2678477/2984177
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170428kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 15271ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 30 PID: 17529 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e13e38f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e13e3980 ffffffffbe1cc4ba 024000c0e13e3918 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e13e3920 ffff952400000010 ffffae59e13e3990 ffffae59e13e3940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444937 inactive_anon:577501 isolated_anon:1066
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244604kB inactive_anon:1356540kB active_file:28147220kB inactive_file:6541656kB unevictable:23400kB isolated(anon):1504kB isolated(file):120kB mapped:124184kB dirty:6552484kB writeback:720kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:704 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535144kB inactive_anon:953464kB active_file:35340024kB inactive_file:2892228kB unevictable:141172kB isolated(anon):2760kB isolated(file):240kB mapped:67916kB dirty:2895276kB writeback:680kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1152 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42020kB min:42256kB low:88648kB high:135040kB active_anon:10349792kB inactive_anon:1324396kB active_file:27291764kB inactive_file:6533716kB unevictable:23392kB writepending:6545264kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44724kB min:45104kB low:94624kB high:144144kB active_anon:9535144kB inactive_anon:953464kB active_file:35340024kB inactive_file:2892228kB unevictable:141172kB writepending:2895956kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76040kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1413*4kB (UME) 1914*8kB (UME) 1138*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43716kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 891*4kB (UME) 960*8kB (UME) 780*16kB (UMEH) 374*32kB (UME) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46060kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235962 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1255 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078176, delete 1076921, find 2678525/2984268
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8168152kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 25931ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 19730 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0a3690 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0a3718 ffffffffbe1cc4ba 024280cace0a36b0 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0a36b8 ffff953000000010 ffffae59ce0a3728 ffffae59ce0a36d8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1f7691>] __get_user_pages+0x171/0x730
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1f805f>] get_user_pages+0x4f/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076a030>] __gfn_to_pfn_memslot+0x120/0x420 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0787846>] try_async_pf+0x66/0x230 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076c1ba>] ? kvm_host_page_size+0x8a/0xa0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790d20>] tdp_page_fault+0x130/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1da80a>] ? pgdat_reclaimable+0x6a/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd71c>] ? handle_mm_fault+0xb9c/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:220kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:759 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:660kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1153 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41676kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544652kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44820kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2895000kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:128kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 775*4kB (UME) 979*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 45892kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166608kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 31816ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879f0 ffff952400000010 ffffae59ce887a60 ffffae59ce887a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe11ad81>] ? ktime_get+0x41/0xb0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:220kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:1147 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:660kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:544 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41676kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544652kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44820kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2895000kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 801*4kB (UME) 982*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46020kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166608kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#0: page allocation stalls for 26009ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 12 PID: 2481 Comm: writer#0 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9679c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce967a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9679f0 ffff952400000010 ffffae59ce967a60 ffffae59ce967a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:216kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:40971 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:656kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:39397 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41804kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544648kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44824kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2894996kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 801*4kB (UME) 982*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46020kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166608kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 26034ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 28 PID: 19260 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2eb8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2eb980 ffffffffbe1cc4ba 024000c0ce2eb918 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2eb920 ffff953000000010 ffffae59ce2eb990 ffffae59ce2eb940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81ae80>] ? rwsem_down_write_failed_killable+0x1b0/0x3e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444941 inactive_anon:577320 isolated_anon:1021
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244628kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6540860kB unevictable:23400kB isolated(anon):904kB isolated(file):760kB mapped:124184kB dirty:6552372kB writeback:332kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:952912kB active_file:35340028kB inactive_file:2892260kB unevictable:141172kB isolated(anon):3180kB isolated(file):112kB mapped:67916kB dirty:2894340kB writeback:684kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:896 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7904kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42132kB min:42256kB low:88648kB high:135040kB active_anon:10349816kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6532920kB unevictable:23392kB writepending:6544764kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45024kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:952912kB active_file:35340028kB inactive_file:2892260kB unevictable:141172kB writepending:2895024kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1355*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43540kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 828*4kB (UME) 989*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46184kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236025 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1403 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078659, delete 1077256, find 2678525/2984269
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 42229ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 1 PID: 2520 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16fa50 ffffffffbe1cc4ba 024200cace16f9e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9f0 ffff952400000010 ffffae59ce16fa60 ffffae59ce16fa10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe21412a>] swapin_readahead+0x12a/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42052kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44944kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1390*4kB (UME) 1940*8kB (UME) 1142*16kB (UMEH) 149*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44248kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 929*4kB (UME) 1086*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47380kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1169 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079162, delete 1077993, find 2678579/2984370
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165772kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 20040ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 26 PID: 19454 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce38f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce38f980 ffffffffbe1cc4ba 024000c0ce38f918 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce38f920 ffff953000000010 ffffae59ce38f990 ffffae59ce38f940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81ae80>] ? rwsem_down_write_failed_killable+0x1b0/0x3e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:544 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:411 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42052kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44944kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1458*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44592kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 930*4kB (UME) 1086*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47384kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1154 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079179, delete 1078025, find 2678579/2984370
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165772kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 29063ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 13184 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ced777d8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ced77860 ffffffffbe1cc4ba 024000c0ced777f8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ced77800 ffff952400000010 ffffae59ced77870 ffffae59ced77820
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2a6f7c>] eventfd_poll+0x2c/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6db041>] ? skb_free_head+0x21/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6dd265>] ? skb_release_data+0xf5/0x130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:320 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:257 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42056kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45028kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1493*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44732kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1045*4kB (UME) 1091*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47884kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1120 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079179, delete 1078059, find 2678579/2984371
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165772kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: in:imjournal: page allocation stalls for 20890ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 2006 Comm: in:imjournal Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc87a50 ffffffffbe1cc4ba 024200cacdc879e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc879f0 ffff953000000010 ffffae59cdc87a60 ffffae59cdc87a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe10d45d>] ? call_rcu_sched+0x1d/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe27116c>] ? dentry_free+0x3c/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe272124>] ? __dentry_kill+0xf4/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444652 inactive_anon:576918 isolated_anon:938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):792kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533512kB inactive_anon:953620kB active_file:35340024kB inactive_file:2892512kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1596kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:282 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42188kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544420kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45036kB min:45104kB low:94624kB high:144144kB active_anon:9533512kB inactive_anon:953620kB active_file:35340024kB inactive_file:2892512kB unevictable:141172kB writepending:2895344kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1510*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44800kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1077*4kB (UME) 1099*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48076kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235993 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1121 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079195, delete 1078074, find 2678579/2984372
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165708kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 38686ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 14 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a50 ffffffffbe1cc4ba 024200cace8879e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879f0 ffff952400000010 ffffae59ce887a60 ffffae59ce887a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe11ad81>] ? ktime_get+0x41/0xb0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444639 inactive_anon:576425 isolated_anon:1002
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245556kB inactive_anon:1352652kB active_file:28147220kB inactive_file:6542668kB unevictable:23400kB isolated(anon):448kB isolated(file):1016kB mapped:124236kB dirty:6554580kB writeback:336kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533000kB inactive_anon:953048kB active_file:35340020kB inactive_file:2892348kB unevictable:141172kB isolated(anon):3560kB isolated(file):112kB mapped:67956kB dirty:2894176kB writeback:2228kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7744kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41992kB min:42256kB low:88648kB high:135040kB active_anon:10350744kB inactive_anon:1320508kB active_file:27291764kB inactive_file:6534856kB unevictable:23392kB writepending:6546976kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140516kB kernel_stack:10472kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44644kB min:45104kB low:94624kB high:144144kB active_anon:9533000kB inactive_anon:953048kB active_file:35340020kB inactive_file:2892348kB unevictable:141172kB writepending:2896404kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75944kB kernel_stack:6136kB pagetables:41112kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1032*4kB (UME) 1993*8kB (UME) 1144*16kB (UMEH) 153*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43400kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 500*4kB (UME) 1056*8kB (UME) 785*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 45504kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236422 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079634, delete 1078425, find 2678696/2984501
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165276kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 35060ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 9 PID: 2283 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce21b9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce21ba50 ffffffffbe1cc4ba 024200cace21b9e8 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce21b9f0 ffff952400000010 ffffae59ce21ba60 ffffae59ce21ba10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0e16e4>] ? pick_next_task_fair+0x324/0x4d0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe02fdf9>] ? sched_clock+0x9/0x10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5420540 inactive_anon:599988 isolated_anon:1226
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12246288kB inactive_anon:1351300kB active_file:28147220kB inactive_file:6543568kB unevictable:23400kB isolated(anon):576kB isolated(file):120kB mapped:124236kB dirty:6554612kB writeback:232kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9435872kB inactive_anon:1048652kB active_file:35340020kB inactive_file:2892320kB unevictable:141172kB isolated(anon):4328kB isolated(file):112kB mapped:68008kB dirty:2894152kB writeback:1872kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42160kB min:42256kB low:88648kB high:135040kB active_anon:10351476kB inactive_anon:1319156kB active_file:27291764kB inactive_file:6535628kB unevictable:23392kB writepending:6546904kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140532kB kernel_stack:10456kB pagetables:75412kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44704kB min:45104kB low:94624kB high:144144kB active_anon:9435872kB inactive_anon:1048652kB active_file:35340020kB inactive_file:2892320kB unevictable:141172kB writepending:2896024kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75920kB kernel_stack:6056kB pagetables:41112kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 838*4kB (UME) 2118*8kB (UME) 1144*16kB (UMEH) 152*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43592kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 679*4kB (UME) 1058*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46252kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236457 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1320 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1080292, delete 1078972, find 2678822/2984731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8164552kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10475ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 27 PID: 19728 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3cf8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3cf980 ffffffffbe1cc4ba 024000c0ce3cf918 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3cf920 ffff952400000010 ffffae59ce3cf990 ffffae59ce3cf940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0d5e33>] ? update_load_avg+0x73/0x360
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe258f67>] ? __vfs_write+0x37/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:144 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42208kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547312kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140616kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44644kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:16kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 963*4kB (UME) 2112*8kB (UME) 1149*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44060kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1244*4kB (UME) 1010*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1672 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081449, delete 1079777, find 2678822/2984731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159928kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: iscsid:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 10485ms, order:0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 36153ms, order:0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 31 PID: 2255 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfbb9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfbba50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfbb9f0 ffff952400000010 ffffae59cdfbba60 ffffae59cdfbba10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe21412a>] swapin_readahead+0x12a/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] ? do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 26 PID: 2041 Comm: iscsid Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839c8 ffffffffbe3f40bd ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10410ms, order:0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce283a50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839f0 ffff952400000010 ffffae59ce283a60 ffffae59ce283a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81b687>] ? do_nanosleep+0x97/0xf0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 23 PID: 17635 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c7970
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42192kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547312kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c79f8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe1cc4ba 024000c0ce3c7990
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c7998 ffff953000000010
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c7a08
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 2931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c79b8
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:24kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42540kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547308kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d7900>] skb_page_frag_refill+0xd0/0x120
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d81dd>] sk_page_frag_refill+0x1d/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe74ad87>] tcp_sendmsg+0x207/0xc00
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe7778d5>] inet_sendmsg+0x65/0xa0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d3a38>] sock_sendmsg+0x38/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4542>] ___sys_sendmsg+0x2c2/0x2d0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44832kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:44kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2a73c7>] ? eventfd_ctx_read+0x67/0x1b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe0ce150>] ? wake_up_q+0x80/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2a756c>] ? eventfd_read+0x5c/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2585d7>] ? __vfs_read+0x37/0x150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe278b35>] ? __fget_light+0x25/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4e94>] __sys_sendmsg+0x54/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe6d4ee2>] SyS_sendmsg+0x12/0x20
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:232kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1280 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1440 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 927*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UM)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB = 183944kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 966*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 927*32kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2112*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1148*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 152*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42688kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547308kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*128kB 0*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UM)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 183944kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44056kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 966*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:45108kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:172kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 1182*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2112*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1148*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1015*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 786*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 152*32kB (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 379*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 122*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 8*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44056kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1182*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 47920kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1015*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 786*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 379*32kB (UMEH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 8*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1673 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081450, delete 1079777, find 2678822/2984731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*512kB (MH)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 47920kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 927*32kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 372*64kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1675 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081452, delete 1079777, find 2678822/2984731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 935*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43932kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1151*4kB (UME) 1015*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47796kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1675 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081452, delete 1079777, find 2678822/2984731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159924kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 27321ms, order:0, mode:0x24000c0(GFP_KERNEL)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 8 PID: 19621 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f980 ffffffffbe1cc4ba 024000c0cda2f918 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f920 ffff952400000010 ffffae59cda2f990 ffffae59cda2f940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07687f3>] ? kvm_write_guest_cached+0x73/0xd0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07a31ac>] ? kvm_lapic_sync_from_vapic+0xac/0x170 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419697 inactive_anon:600569 isolated_anon:838
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244156kB inactive_anon:1353116kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1324kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:831 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41948kB min:42256kB low:88648kB high:135040kB active_anon:10349344kB inactive_anon:1320972kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547344kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140628kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB writepending:2896176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 915*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43852kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1292*4kB (UME) 1064*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48752kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237371 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1654 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081546, delete 1079892, find 2678826/2984738
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159560kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 25143ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 19583 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf307b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf307be0 ffffffffbe1cc4ba 025200c200000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf307b80 ffff952400000010 ffffae59cf307bf0 ffffae59cf307ba0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe262729>] pipe_write+0x1e9/0x410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe259015>] __vfs_write+0xe5/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419697 inactive_anon:600569 isolated_anon:838
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244156kB inactive_anon:1353116kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:264kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:506 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1260kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:480 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41948kB min:42256kB low:88648kB high:135040kB active_anon:10349344kB inactive_anon:1320972kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547340kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140628kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB writepending:2896112kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:12kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 917*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43860kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1292*4kB (UME) 1065*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48760kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237371 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1654 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081546, delete 1079892, find 2678826/2984738
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159560kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: systemd-journal: page allocation stalls for 40809ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 1649 Comm: systemd-journal Not tainted 4.9.5-200.fc25.x86_64 #1
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd937a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379f0 ffff953000000010 ffffae59cd937a60 ffffae59cd937a10
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe003cdd>] ? do_syscall_64+0x12d/0x180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [<ffffffffbe81e148>] page_fault+0x28/0x30
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5420052 inactive_anon:599904 isolated_anon:461
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244620kB inactive_anon:1351324kB active_file:28147220kB inactive_file:6543608kB unevictable:23400kB isolated(anon):1160kB isolated(file):760kB mapped:124236kB dirty:6554256kB writeback:640kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:896 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9435588kB inactive_anon:1048292kB active_file:35340800kB inactive_file:2894612kB unevictable:141172kB isolated(anon):684kB isolated(file):240kB mapped:68008kB dirty:2895132kB writeback:1548kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7768kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42204kB min:42256kB low:88648kB high:135040kB active_anon:10349808kB inactive_anon:1319180kB active_file:27291764kB inactive_file:6535668kB unevictable:23392kB writepending:6546956kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140740kB kernel_stack:10536kB pagetables:75420kB bounce:0kB free_pcp:16kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45076kB min:45104kB low:94624kB high:144144kB active_anon:9435588kB inactive_anon:1048292kB active_file:35340800kB inactive_file:2894612kB unevictable:141172kB writepending:2896680kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75968kB kernel_stack:6120kB pagetables:41112kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183996kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1030*4kB (UME) 1986*8kB (UME) 1160*16kB (UME) 160*32kB (UME) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43752kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1017*4kB (UME) 1131*8kB (UME) 783*16kB (UMEH) 380*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48172kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18238165 total pagecache pages
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1671 pages in swap cache
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1083334, delete 1081663, find 2679462/2985930
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8156400kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
Mar 14 17:22:07 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:22:17 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:22:27 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:22:37 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:22:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:22:57 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: [ERROR] 404 response: Not Found (remaining tries: 0)
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: [ERROR] Job aborted because web UI doesn't accept updates anymore (likely considers this job dead)
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: Mojo::Reactor::Poll: Timer failed: No worker id or webui host set! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 181.
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[34675]: [ERROR] backend crashed ...
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[34675]: killed 19708 - waiting for exit at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 47.
Mar 14 17:23:02 qa09.qa.fedoraproject.org worker[5951]: [ERROR] backend crashed ...
Mar 14 17:23:02 qa09.qa.fedoraproject.org worker[5951]: killed 19239 - waiting for exit at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 47.
Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[5943]: WebUI Mojo::IOLoop=HASH(0x3558158) is unknown! - Should not happen but happened, exiting! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 404.
Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[34675]: can't open /var/lib/openqa/pool/6/testresults/result-_do_install_and_reboot.json: No such file or directory at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 735.
Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[5943]: [INFO] registering worker with openQA Mojo::IOLoop=HASH(0x3558158)...
Mar 14 17:23:04 qa09.qa.fedoraproject.org worker[5838]: [ERROR] 404 response: Not Found (remaining tries: 0)
Mar 14 17:23:04 qa09.qa.fedoraproject.org worker[5838]: [ERROR] Job aborted because web UI doesn't accept updates anymore (likely considers this job dead)
Mar 14 17:23:05 qa09.qa.fedoraproject.org worker[5838]: Mojo::Reactor::Poll: Timer failed: No worker id or webui host set! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 181.
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[5951]: can't open /var/lib/openqa/pool/9/testresults/result-_do_install_and_reboot.json: No such file or directory at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 735.
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] killing os-autoinst 19708
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] cleaning up 00079976-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_simple_free_space@uefi
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] got job 79977: 00079977-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-upgrade_minimal_64bit@64bit
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] 20668: WORKING 79977
Mar 14 17:23:07 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] killing os-autoinst 19239
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] cleaning up 00079743-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_simple_encrypted@uefi
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] got job 79978: 00079978-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_multi_empty@uefi
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] 20674: WORKING 79978
Mar 14 17:23:15 qa09.qa.fedoraproject.org worker[5838]: WebUI Mojo::IOLoop=HASH(0x325d0b0) is unknown! - Should not happen but happened, exiting! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 404.
Mar 14 17:23:15 qa09.qa.fedoraproject.org worker[5838]: [INFO] registering worker with openQA Mojo::IOLoop=HASH(0x325d0b0)...
Mar 14 17:23:16 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
Mar 14 17:23:16 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
Mar 14 17:23:17 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:23:22 qa09.qa.fedoraproject.org kernel: kvm [20683]: vcpu0, guest rIP: 0xffffffff8805e7e2 unhandled rdmsr: 0x34
Mar 14 17:23:25 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
Mar 14 17:23:25 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
Mar 14 17:23:27 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:23:30 qa09.qa.fedoraproject.org kernel: kvm [20706]: vcpu1, guest rIP: 0xffffffffb3060bd2 unhandled rdmsr: 0x34
Mar 14 17:23:37 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19431 (perl) with signal SIGKILL.
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19433 (/usr/bin/isotov) with signal SIGKILL.
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19434 (/usr/bin/isotov) with signal SIGKILL.
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19435 (/usr/bin/isotov) with signal SIGKILL.
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19438 (videoencoder) with signal SIGKILL.
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19443 (qemu-system-x86) with signal SIGKILL.
Mar 14 17:23:41 qa09.qa.fedoraproject.org audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=openqa-worker@8 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Mar 14 17:23:41 qa09.qa.fedoraproject.org audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=openqa-worker@8 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Mar 14 17:23:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17509 (perl) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17511 (/usr/bin/isotov) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17512 (/usr/bin/isotov) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17514 (/usr/bin/isotov) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17516 (videoencoder) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17519 (qemu-system-x86) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38944 (gstack) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38948 (gdb) with signal SIGKILL.
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38949 (sed) with signal SIGKILL.
    (1-1/1)