Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10023ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 13184 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59ced77780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59ced77808 ffffffffbe1cc4ba 024000c0ced777a0 ffffffffbec50c88 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59ced777a8 ffff952400000010 ffffae59ced77818 ffffae59ced777c8 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? sched_clock+0x9/0x10 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] __pollwait+0x99/0xe0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] datagram_poll+0x29/0x100 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] udp_poll+0x19/0x90 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] sock_poll+0x80/0xa0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] do_sys_poll+0x26e/0x550 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? __release_sock+0x9c/0xf0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? _raw_spin_unlock_bh+0x1a/0x20 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? release_sock+0x8c/0xa0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_initwait+0x50/0x50 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] SyS_ppoll+0x170/0x1a0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: active_anon:5416590 inactive_anon:604564 isolated_anon:980 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12142708kB inactive_anon:1449936kB active_file:28146220kB inactive_file:6548800kB unevictable:23400kB isolated(anon):1772kB isolated(file):1016kB mapped:124260kB dirty:6556972kB writeback:2352kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 256kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9523652kB inactive_anon:968320kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB isolated(anon):2148kB isolated(file):368kB mapped:67840kB dirty:2896056kB writeback:1120kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183952kB min:2732kB low:5732kB high:8732kB active_anon:1891120kB inactive_anon:35836kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2020kB kernel_stack:256kB pagetables:780kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42016kB min:42256kB low:88648kB high:135040kB active_anon:10251588kB inactive_anon:1414100kB active_file:27290764kB inactive_file:6540864kB unevictable:23392kB writepending:6551388kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140788kB kernel_stack:11080kB pagetables:75540kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44688kB min:45104kB low:94624kB high:144144kB active_anon:9523652kB inactive_anon:968320kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB writepending:2897176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76096kB kernel_stack:6120kB pagetables:40796kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3066*4kB (UME) 3321*8kB (UME) 1828*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183984kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1284*4kB (UME) 1636*8kB (UME) 1124*16kB (UMEH) 196*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42800kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1471*4kB (UME) 988*8kB (UME) 769*16kB (UMEH) 409*32kB (UMEH) 80*64kB (UMEH) 0*128kB 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45324kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 18238526 total pagecache pages Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 1314 pages in swap cache Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1065298, delete 1063984, find 2675730/2979213 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Free swap = 8188076kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10404ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: CPU: 21 PID: 18924 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59cced38f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59cced3980 ffffffffbe1cc4ba 024000c0cced3918 ffffffffbec50c88 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: ffffae59cced3920 ffff953000000010 ffffae59cced3990 ffffae59cced3940 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] ? __vfs_write+0xe5/0x160 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: active_anon:5416523 inactive_anon:604628 isolated_anon:983 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12142704kB inactive_anon:1449928kB active_file:28146220kB inactive_file:6549056kB unevictable:23400kB isolated(anon):1784kB isolated(file):760kB mapped:124260kB dirty:6556972kB writeback:2360kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 256kB writeback_tmp:0kB unstable:0kB pages_scanned:448 all_unreclaimable? no Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9523388kB inactive_anon:968584kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB isolated(anon):2148kB isolated(file):368kB mapped:67840kB dirty:2896056kB writeback:1120kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:608 all_unreclaimable? no Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1891120kB inactive_anon:35836kB active_file:855456kB inactive_file:7552kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2020kB kernel_stack:256kB pagetables:780kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42168kB min:42256kB low:88648kB high:135040kB active_anon:10251584kB inactive_anon:1414092kB active_file:27290764kB inactive_file:6541120kB unevictable:23392kB writepending:6551396kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140788kB kernel_stack:11080kB pagetables:75540kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44852kB min:45104kB low:94624kB high:144144kB active_anon:9523388kB inactive_anon:968584kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB writepending:2897176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76096kB kernel_stack:6120kB pagetables:40796kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3066*4kB (UME) 3321*8kB (UME) 1828*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183984kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1276*4kB (UME) 1636*8kB (UME) 1124*16kB (UMEH) 196*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42768kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1496*4kB (UME) 988*8kB (UME) 769*16kB (UMEH) 409*32kB (UMEH) 80*64kB (UMEH) 0*128kB 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45424kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 18238528 total pagecache pages Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 1316 pages in swap cache Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1065300, delete 1063984, find 2675731/2979215 Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Free swap = 8188068kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:21:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: reader#1: page allocation stalls for 13921ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: CPU: 22 PID: 2487 Comm: reader#1 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: ffffae59cddbb9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: ffffae59cddbba50 ffffffffbe1cc4ba 024200cacddbb9e8 ffffffffbec50c88 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: ffffae59cddbb9f0 ffff952400000010 ffffae59cddbba60 ffffae59cddbba10 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] ? dput+0xd9/0x260 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] ? do_statfs_native+0xa7/0xd0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: active_anon:5419918 inactive_anon:600157 isolated_anon:886 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12151060kB inactive_anon:1439184kB active_file:28146312kB inactive_file:6548092kB unevictable:23400kB isolated(anon):3112kB isolated(file):632kB mapped:124216kB dirty:6557004kB writeback:1236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 200kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9528612kB inactive_anon:961444kB active_file:35339696kB inactive_file:2895048kB unevictable:141172kB isolated(anon):432kB isolated(file):240kB mapped:67896kB dirty:2895812kB writeback:1064kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:768 all_unreclaimable? no Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1891504kB inactive_anon:35448kB active_file:855456kB inactive_file:7776kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2016kB kernel_stack:256kB pagetables:784kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42172kB min:42256kB low:88648kB high:135040kB active_anon:10259556kB inactive_anon:1403736kB active_file:27290856kB inactive_file:6540152kB unevictable:23392kB writepending:6550300kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140680kB kernel_stack:10536kB pagetables:75452kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9528612kB inactive_anon:961444kB active_file:35339696kB inactive_file:2895048kB unevictable:141172kB writepending:2896876kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76140kB kernel_stack:5992kB pagetables:40756kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184012kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1408*4kB (UME) 1695*8kB (UME) 1123*16kB (UMEH) 198*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43816kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1552*4kB (UME) 1087*8kB (UME) 777*16kB (UMEH) 411*32kB (UMEH) 81*64kB (UMEH) 2*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46952kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 18238501 total pagecache pages Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 1695 pages in swap cache Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1067280, delete 1065585, find 2675818/2979365 Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Free swap = 8182020kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:21:57 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:22:19 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 21494ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 6 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? _raw_spin_unlock_bh+0x1a/0x20 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] pipe_write+0x1e9/0x410 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442964 inactive_anon:578700 isolated_anon:711 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240400kB inactive_anon:1356592kB active_file:28146696kB inactive_file:6544012kB unevictable:23400kB isolated(anon):2344kB isolated(file):888kB mapped:124248kB dirty:6553092kB writeback:884kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531456kB inactive_anon:958208kB active_file:35339704kB inactive_file:2892108kB unevictable:141172kB isolated(anon):500kB isolated(file):496kB mapped:67916kB dirty:2894744kB writeback:860kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:641 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7780kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42156kB min:42256kB low:88648kB high:135040kB active_anon:10345604kB inactive_anon:1324444kB active_file:27291240kB inactive_file:6536076kB unevictable:23392kB writepending:6546040kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9531456kB inactive_anon:958208kB active_file:35339704kB inactive_file:2892108kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76120kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1591*4kB (UME) 1846*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44364kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 567*4kB (UME) 1343*8kB (UME) 848*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45428kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237265 total pagecache pages Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1765 pages in swap cache Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070652, delete 1068887, find 2677059/2981593 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap = 8179632kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 15381ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 23 PID: 19713 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cf71bb60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cf71bbe8 ffffffffbe1cc4ba 024280cacf71bb80 ffffffffbec50c88 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59cf71bb88 ffff953000000010 ffffae59cf71bbf8 ffffae59cf71bba8 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? futex_wait+0xf9/0x260 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x13bd/0x1610 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442935 inactive_anon:578836 isolated_anon:679 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240448kB inactive_anon:1356932kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2344kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:884kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:41 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958412kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):372kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:892kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7780kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345652kB inactive_anon:1324780kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546040kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958412kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895600kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1639*4kB (UME) 1848*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44572kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 616*4kB (UME) 1344*8kB (UME) 848*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45632kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237255 total pagecache pages Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1760 pages in swap cache Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070662, delete 1068902, find 2677061/2981597 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap = 8179600kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 11032ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 19618 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59ce94f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59ce94f980 ffffffffbe1cc4ba 024000c0ce94f918 ffffffffbec50c88 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59ce94f920 ffff952400000010 ffffae59ce94f990 ffffae59ce94f940 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 23637ms, order:0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: , mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? wake_up_q+0x80/0x80 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? __vfs_write+0x37/0x160 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 9 PID: 20329 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59e164b838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442947 inactive_anon:578811 isolated_anon:679 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59e164b8c0 ffffffffbe1cc4ba 0342004ae164b858 ffffffffbec50c88 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: ffffae59e164b860 ffff952400000010 ffffae59e164b8d0 ffffae59e164b880 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240496kB inactive_anon:1356960kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2216kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:1039 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):500kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? alloc_buffer_head+0x21/0x60 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? alloc_buffer_head+0x21/0x60 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] __page_cache_alloc+0xcb/0x100 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240 48240 48240 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] pagecache_get_page+0xb5/0x2f0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? unlock_page+0x4c/0x60 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] grab_cache_page_write_begin+0x20/0x40 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7772kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] iomap_write_begin+0x51/0x130 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] iomap_write_actor+0xa8/0x180 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308 45308 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] iomap_apply+0xb1/0x130 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345700kB inactive_anon:1324808kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546052kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] iomap_file_buffered_write+0x70/0x90 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] xfs_file_buffered_aio_write+0x11e/0x270 [xfs] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? __kmalloc+0x168/0x1f0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? __check_object_size+0xff/0x1d6 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] xfs_file_write_iter+0x103/0x150 [xfs] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] do_iter_readv_writev+0xb6/0x140 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] do_readv_writev+0x19e/0x240 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs] Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? check_preempt_curr+0x79/0x90 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? wake_up_new_task+0x14a/0x1f0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] ? recalc_sigpending+0x1b/0x50 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] vfs_writev+0x3c/0x50 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] do_pwritev+0xb2/0xd0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] SyS_pwritev+0x11/0x20 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 1*128kB (U) 1*256kB (U) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442947 inactive_anon:578811 isolated_anon:679 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240496kB inactive_anon:1356960kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2216kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:1679 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):500kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:1792 all_unreclaimable? no Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4096kB = 183988kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1677*4kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1855*8kB (UME) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1128*16kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMEH) 156*32kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMH) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7772kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*64kB (H) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*128kB (H) 0*256kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*1024kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345700kB inactive_anon:1324808kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546052kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: = 44780kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 719*4kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1351*8kB (UME) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 849*16kB (UMEH) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 377*32kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 84*64kB (UMEH) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 3*128kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*256kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (H) 0*2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: DMA: Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: = 46116kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*8kB (U) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237241 total pagecache pages Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*16kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1737 pages in swap cache Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070721, delete 1068984, find 2677062/2981599 Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap = 8179488kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 0*32kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 2*64kB (U) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 1*256kB (U) Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1677*4kB (UME) 1855*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44780kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 719*4kB (UME) 1351*8kB (UME) 849*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46116kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237241 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1737 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070721, delete 1068984, find 2677062/2981599 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8179488kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: in:imjournal: page allocation stalls for 17228ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 2006 Comm: in:imjournal Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc878f0 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc87978 ffffffffbe1cc4ba 0342004acdc87910 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc87918 ffff953000000010 ffffae59cdc87988 ffffae59cdc87938 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __page_cache_alloc+0xcb/0x100 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pagecache_get_page+0xb5/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] grab_cache_page_write_begin+0x20/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_begin+0x51/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_actor+0xa8/0x180 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_apply+0xb1/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_file_buffered_write+0x70/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_buffered_aio_write+0x11e/0x270 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_write_iter+0x103/0x150 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443119 inactive_anon:577373 isolated_anon:790 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241144kB inactive_anon:1353008kB active_file:28146764kB inactive_file:6545028kB unevictable:23400kB isolated(anon):2696kB isolated(file):504kB mapped:124216kB dirty:6555064kB writeback:640kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:768 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531332kB inactive_anon:956484kB active_file:35339692kB inactive_file:2892788kB unevictable:141172kB isolated(anon):464kB isolated(file):1008kB mapped:67916kB dirty:2895500kB writeback:612kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:640 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894788kB inactive_anon:32152kB active_file:855456kB inactive_file:7808kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42156kB min:42256kB low:88648kB high:135040kB active_anon:10346356kB inactive_anon:1320856kB active_file:27291308kB inactive_file:6537092kB unevictable:23392kB writepending:6547768kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44736kB min:45104kB low:94624kB high:144144kB active_anon:9531332kB inactive_anon:956484kB active_file:35339692kB inactive_file:2892788kB unevictable:141172kB writepending:2896112kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1026*4kB (UME) 1996*8kB (UME) 1143*16kB (UMEH) 160*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43672kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 590*4kB (UME) 1436*8kB (UME) 850*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46296kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237500 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1580 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1071922, delete 1070342, find 2677186/2981768 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8178536kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 14411ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 19577 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cff6f8f0 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cff6f978 ffffffffbe1cc4ba 0342004acff6f910 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cff6f918 ffff953000000010 ffffae59cff6f988 ffffae59cff6f938 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __page_cache_alloc+0xcb/0x100 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pagecache_get_page+0xb5/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] grab_cache_page_write_begin+0x20/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_begin+0x51/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_actor+0xa8/0x180 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_apply+0xb1/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_file_buffered_write+0x70/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_buffered_aio_write+0x11e/0x270 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_write_iter+0x103/0x150 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443139 inactive_anon:577355 isolated_anon:646 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241248kB inactive_anon:1353192kB active_file:28146764kB inactive_file:6545728kB unevictable:23400kB isolated(anon):2120kB isolated(file):1144kB mapped:124216kB dirty:6553772kB writeback:2900kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:1024 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531308kB inactive_anon:956228kB active_file:35339704kB inactive_file:2893392kB unevictable:141172kB isolated(anon):464kB isolated(file):1264kB mapped:67916kB dirty:2895648kB writeback:1212kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:1056 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894792kB inactive_anon:32152kB active_file:855456kB inactive_file:7936kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42144kB min:42256kB low:88648kB high:135040kB active_anon:10346456kB inactive_anon:1321040kB active_file:27291308kB inactive_file:6537792kB unevictable:23392kB writepending:6548736kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9531308kB inactive_anon:956228kB active_file:35339704kB inactive_file:2893392kB unevictable:141172kB writepending:2896860kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 913*4kB (UME) 2003*8kB (UME) 1146*16kB (UMEH) 161*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43356kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 492*4kB (UME) 1449*8kB (UME) 852*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46040kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237942 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1533 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1071983, delete 1070450, find 2677186/2981769 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8178292kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 10849ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 18908 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683be0 ffffffffbe1cc4ba 025200c2e9683b78 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b80 ffff953000000010 ffffae59e9683bf0 ffffae59e9683ba0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pipe_write+0x1e9/0x410 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443256 inactive_anon:577228 isolated_anon:517 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241248kB inactive_anon:1353196kB active_file:28146764kB inactive_file:6545728kB unevictable:23400kB isolated(anon):1604kB isolated(file):1144kB mapped:124216kB dirty:6553772kB writeback:4kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:128 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531776kB inactive_anon:955716kB active_file:35339704kB inactive_file:2893212kB unevictable:141172kB isolated(anon):464kB isolated(file):1136kB mapped:67916kB dirty:2895648kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894792kB inactive_anon:32152kB active_file:855456kB inactive_file:7936kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42124kB min:42256kB low:88648kB high:135040kB active_anon:10346456kB inactive_anon:1321044kB active_file:27291308kB inactive_file:6537792kB unevictable:23392kB writepending:6545840kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:116kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44736kB min:45104kB low:94624kB high:144144kB active_anon:9531776kB inactive_anon:955716kB active_file:35339704kB inactive_file:2893212kB unevictable:141172kB writepending:2895412kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183968kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1202*4kB (UME) 2093*8kB (UME) 1152*16kB (UMEH) 167*32kB (UMH) 4*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45712kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 739*4kB (UME) 1464*8kB (UME) 867*16kB (UMEH) 386*32kB (UMEH) 87*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47868kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237868 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1434 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1072193, delete 1070759, find 2677190/2981777 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8177772kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 33973ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 20329 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e164b838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e164b8c0 ffffffffbe1cc4ba 0342004ae164b858 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e164b860 ffff952400000010 ffffae59e164b8d0 ffffae59e164b880 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? alloc_buffer_head+0x21/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __page_cache_alloc+0xcb/0x100 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pagecache_get_page+0xb5/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? unlock_page+0x4c/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] grab_cache_page_write_begin+0x20/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_begin+0x51/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_actor+0xa8/0x180 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_apply+0xb1/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_file_buffered_write+0x70/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_buffered_aio_write+0x11e/0x270 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __kmalloc+0x168/0x1f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __check_object_size+0xff/0x1d6 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_write_iter+0x103/0x150 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_iter_readv_writev+0xb6/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_readv_writev+0x19e/0x240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? check_preempt_curr+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? wake_up_new_task+0x14a/0x1f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? recalc_sigpending+0x1b/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_writev+0x3c/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_pwritev+0xb2/0xd0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_pwritev+0x11/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543848kB unevictable:23400kB isolated(anon):2156kB isolated(file):1144kB mapped:124220kB dirty:6554556kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2895424kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1224 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7512kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42040kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535916kB unevictable:23392kB writepending:6545716kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1822*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184004kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1186*4kB (UME) 1837*8kB (UME) 1170*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44112kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 457*4kB (UME) 1414*8kB (UME) 870*16kB (UMEH) 363*32kB (UMEH) 92*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45972kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1762 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073714, delete 1071951, find 2677693/2982671 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176484kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 13952ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 19443 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb47780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb47808 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb477a8 ffff953000000010 ffffae59cdb47818 ffffae59cdb477c8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? dequeue_entity+0x259/0xba0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __pollwait+0x99/0xe0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] datagram_poll+0x29/0x100 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] udp_poll+0x19/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] sock_poll+0x80/0xa0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_sys_poll+0x26e/0x550 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __slab_free+0xa1/0x2a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_initwait+0x50/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ppoll+0x170/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:568 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42040kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6545716kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1822*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184004kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1290*4kB (UME) 1841*8kB (UME) 1173*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44608kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 597*4kB (UME) 1427*8kB (UME) 873*16kB (UMEH) 365*32kB (UMEH) 92*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46748kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1653 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073767, delete 1072114, find 2677693/2982671 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176400kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 14016ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 17 PID: 17998 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfa3b60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfa3be8 ffffffffbe1cc4ba 024280cacdfa3b80 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfa3b88 ffff953000000010 ffffae59cdfa3bf8 ffffae59cdfa3ba8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? sched_clock+0x9/0x10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x13bd/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:288 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1289*4kB (UME) 1850*8kB (UME) 1174*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44692kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 705*4kB (UME) 1441*8kB (UME) 873*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47484kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1598 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073892, delete 1072294, find 2677694/2982675 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176156kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 11573ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 8 PID: 17514 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf33fb60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf33fbe8 ffffffffbe1cc4ba 024280cacf33fb80 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf33fb88 ffff952400000010 ffffae59cf33fbf8 ffffae59cf33fba8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? futex_wait+0xf9/0x260 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x13bd/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:224 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1291*4kB (UME) 1850*8kB (UME) 1174*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44700kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 709*4kB (UME) 1441*8kB (UME) 873*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47500kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1598 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073892, delete 1072294, find 2677694/2982675 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176156kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 35229ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 24 PID: 20284 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cfa53838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cfa538c0 ffffffffbe1cc4ba 0342004acfa53858 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cfa53860 ffff953000000010 ffffae59cfa538d0 ffffae59cfa53880 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? handle_mm_fault+0xb9c/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __page_cache_alloc+0xcb/0x100 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pagecache_get_page+0xb5/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] grab_cache_page_write_begin+0x20/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_begin+0x51/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_write_actor+0xa8/0x180 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_apply+0xb1/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] iomap_file_buffered_write+0x70/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? iomap_write_end+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_buffered_aio_write+0x11e/0x270 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __kmalloc+0x168/0x1f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __check_object_size+0xff/0x1d6 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] xfs_file_write_iter+0x103/0x150 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_iter_readv_writev+0xb6/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_readv_writev+0x19e/0x240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? do_futex+0x2dd/0xaf0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_writev+0x3c/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_pwritev+0xb2/0xd0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_pwritev+0x11/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:972 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:12kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894140kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:36kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1326*4kB (UME) 1862*8kB (UME) 1176*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44968kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 794*4kB (UME) 1450*8kB (UME) 874*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47928kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1609 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073924, delete 1072315, find 2677694/2982675 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8176028kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 32043ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? _raw_spin_unlock_bh+0x1a/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pipe_write+0x1e9/0x410 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892468kB unevictable:141172kB isolated(anon):532kB isolated(file):624kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:130 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892468kB unevictable:141172kB writepending:2894140kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1441*4kB (UME) 1869*8kB (UME) 1176*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45484kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 911*4kB (UME) 1464*8kB (UME) 883*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 48684kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1532 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073941, delete 1072409, find 2677694/2982677 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175960kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 10497ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 29 PID: 13179 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9f7be0 ffffffffbe1cc4ba 025200c2ce9f7b78 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9f7b80 ffff952400000010 ffffae59ce9f7bf0 ffffae59ce9f7ba0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pipe_write+0x1e9/0x410 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB isolated(anon):532kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1664 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6543544kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45092kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB writepending:2893416kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1533*4kB (UME) 1884*8kB (UME) 1179*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46020kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1052*4kB (UME) 1494*8kB (UME) 889*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 49584kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1503 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074084, delete 1072581, find 2677694/2982677 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175772kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10585ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 10 PID: 19621 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f980 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f920 ffff952400000010 ffffae59cda2f990 ffffae59cda2f940 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? rwsem_down_write_failed_killable+0x1b0/0x3e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB isolated(anon):532kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:528 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6543544kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45092kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB writepending:2893416kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1536*4kB (UME) 1884*8kB (UME) 1179*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46032kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1054*4kB (UME) 1494*8kB (UME) 889*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 49592kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1503 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074084, delete 1072581, find 2677694/2982677 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175772kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 35202ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? _raw_spin_unlock_bh+0x1a/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pipe_write+0x1e9/0x410 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444748 inactive_anon:578108 isolated_anon:49 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244552kB inactive_anon:1355172kB active_file:28146776kB inactive_file:6537248kB unevictable:23400kB isolated(anon):136kB isolated(file):2808kB mapped:124184kB dirty:6549788kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:128 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534440kB inactive_anon:957260kB active_file:35339712kB inactive_file:2889332kB unevictable:141172kB isolated(anon):60kB isolated(file):368kB mapped:67920kB dirty:2890688kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183932kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32116kB active_file:855456kB inactive_file:7360kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2080kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41776kB min:42256kB low:88648kB high:135040kB active_anon:10349752kB inactive_anon:1323024kB active_file:27291320kB inactive_file:6529312kB unevictable:23392kB writepending:6541244kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375932kB slab_unreclaimable:140816kB kernel_stack:10788kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44688kB min:45104kB low:94624kB high:144144kB active_anon:9534440kB inactive_anon:957260kB active_file:35339712kB inactive_file:2889332kB unevictable:141172kB writepending:2890284kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277088kB slab_unreclaimable:76220kB kernel_stack:6728kB pagetables:41004kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183904kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1117*4kB (UME) 2071*8kB (UME) 1219*16kB (UMEH) 154*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46108kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 580*4kB (UME) 1148*8kB (UME) 975*16kB (UMEH) 405*32kB (UMEH) 96*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47616kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235519 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1313 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074366, delete 1073053, find 2677773/2982822 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175132kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 10401ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 2520 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16fa50 ffffffffbe1cc4ba 024200cace16f9e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9f0 ffff952400000010 ffffae59ce16fa60 ffffae59ce16fa10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x12a/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443745 inactive_anon:579651 isolated_anon:36 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240860kB inactive_anon:1360408kB active_file:28146776kB inactive_file:6538276kB unevictable:23400kB isolated(anon):128kB isolated(file):3192kB mapped:124184kB dirty:6544508kB writeback:1840kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534120kB inactive_anon:958196kB active_file:35339708kB inactive_file:2886176kB unevictable:141172kB isolated(anon):16kB isolated(file):368kB mapped:67920kB dirty:2882980kB writeback:3388kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:513 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183920kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32148kB active_file:855456kB inactive_file:7584kB unevictable:8kB writepending:7920kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2112kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42080kB min:42256kB low:88648kB high:135040kB active_anon:10346060kB inactive_anon:1328260kB active_file:27291320kB inactive_file:6530356kB unevictable:23392kB writepending:6538428kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375928kB slab_unreclaimable:140648kB kernel_stack:10772kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44732kB min:45104kB low:94624kB high:144144kB active_anon:9534120kB inactive_anon:958196kB active_file:35339708kB inactive_file:2886176kB unevictable:141172kB writepending:2887092kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277088kB slab_unreclaimable:76008kB kernel_stack:6744kB pagetables:41004kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3069*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183932kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1332*4kB (UME) 2009*8kB (UME) 1215*16kB (UMEH) 154*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46408kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 558*4kB (UME) 1132*8kB (UME) 1004*16kB (UMEH) 407*32kB (UMEH) 96*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47928kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234465 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1344 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074488, delete 1073144, find 2677899/2983053 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175276kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: warn_alloc: 1 callbacks suppressed Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 12995ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 0 PID: 19619 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb67690 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb67718 ffffffffbe1cc4ba 024280cacdb676b0 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdb676b8 ffff952400000010 ffffae59cdb67728 ffffae59cdb676d8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x13bd/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_user_pages+0x171/0x730 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] get_user_pages+0x4f/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __gfn_to_pfn_memslot+0x120/0x420 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] try_async_pf+0x66/0x230 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? kvm_host_page_size+0x8a/0xa0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x130/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443218 inactive_anon:581444 isolated_anon:98 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12239420kB inactive_anon:1363496kB active_file:28146964kB inactive_file:6540428kB unevictable:23400kB isolated(anon):136kB isolated(file):248kB mapped:124184kB dirty:6551296kB writeback:28kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533452kB inactive_anon:962280kB active_file:35339912kB inactive_file:2887240kB unevictable:141172kB isolated(anon):256kB isolated(file):240kB mapped:67916kB dirty:2889532kB writeback:1080kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 148kB writeback_tmp:0kB unstable:0kB pages_scanned:674 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183936kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32148kB active_file:855456kB inactive_file:7792kB unevictable:8kB writepending:7920kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2108kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41904kB min:42256kB low:88648kB high:135040kB active_anon:10344620kB inactive_anon:1331348kB active_file:27291508kB inactive_file:6532508kB unevictable:23392kB writepending:6543404kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375924kB slab_unreclaimable:140824kB kernel_stack:10664kB pagetables:75424kB bounce:0kB free_pcp:36kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44300kB min:45104kB low:94624kB high:144144kB active_anon:9533452kB inactive_anon:962280kB active_file:35339912kB inactive_file:2887240kB unevictable:141172kB writepending:2890612kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277084kB slab_unreclaimable:76524kB kernel_stack:6600kB pagetables:40904kB bounce:0kB free_pcp:136kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3070*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183952kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1039*4kB (UME) 1813*8kB (UME) 1145*16kB (UMEH) 168*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42996kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 803*4kB (UME) 892*8kB (UME) 862*16kB (UMEH) 433*32kB (UMEH) 113*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46636kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234194 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1112 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074739, delete 1073627, find 2678054/2983360 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8175196kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#1: page allocation stalls for 11515ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 2482 Comm: writer#1 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdcc79c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdcc7a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdcc79f0 ffff952400000010 ffffae59cdcc7a60 ffffae59cdcc7a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? SYSC_sendto+0x157/0x190 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443734 inactive_anon:580423 isolated_anon:166 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12239472kB inactive_anon:1362784kB active_file:28147060kB inactive_file:6539600kB unevictable:23400kB isolated(anon):264kB isolated(file):2040kB mapped:124184kB dirty:6550600kB writeback:1520kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:7904 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535464kB inactive_anon:958908kB active_file:35339968kB inactive_file:2889200kB unevictable:141172kB isolated(anon):400kB isolated(file):112kB mapped:67916kB dirty:2891828kB writeback:436kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32156kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7928kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2012kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42212kB min:42256kB low:88648kB high:135040kB active_anon:10344672kB inactive_anon:1330628kB active_file:27291604kB inactive_file:6531676kB unevictable:23392kB writepending:6544192kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140692kB kernel_stack:10616kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44760kB min:45104kB low:94624kB high:144144kB active_anon:9535464kB inactive_anon:958908kB active_file:35339968kB inactive_file:2889200kB unevictable:141172kB writepending:2892264kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277064kB slab_unreclaimable:76088kB kernel_stack:6488kB pagetables:40892kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1455*4kB (UME) 1819*8kB (UME) 1127*16kB (UMEH) 158*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43844kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 840*4kB (UME) 978*8kB (UME) 771*16kB (UMEH) 387*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46400kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235423 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1489 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076439, delete 1074950, find 2678314/2983846 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170360kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: NetworkManager: page allocation stalls for 12047ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 1975 Comm: NetworkManager Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0e79c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0e7a50 ffffffffbe1cc4ba 024200cace0e79e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0e79f0 ffff953000000010 ffffae59ce0e7a60 ffffae59ce0e7a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444325 inactive_anon:580396 isolated_anon:70 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240912kB inactive_anon:1362672kB active_file:28147060kB inactive_file:6539752kB unevictable:23400kB isolated(anon):264kB isolated(file):1144kB mapped:124184kB dirty:6550824kB writeback:204kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:64 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536388kB inactive_anon:958912kB active_file:35339968kB inactive_file:2889512kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891684kB writeback:624kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7736kB unevictable:8kB writepending:7928kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2012kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42024kB min:42256kB low:88648kB high:135040kB active_anon:10346112kB inactive_anon:1330520kB active_file:27291604kB inactive_file:6531824kB unevictable:23392kB writepending:6543100kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140628kB kernel_stack:10616kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44732kB min:45104kB low:94624kB high:144144kB active_anon:9536388kB inactive_anon:958912kB active_file:35339968kB inactive_file:2889512kB unevictable:141172kB writepending:2892308kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76064kB kernel_stack:6488kB pagetables:40892kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184012kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1359*4kB (UME) 1819*8kB (UME) 1127*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43428kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 732*4kB (UME) 938*8kB (UME) 771*16kB (UMEH) 387*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45648kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235203 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1476 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076446, delete 1074970, find 2678315/2983848 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170336kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 12777ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 31 PID: 17985 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc1f970 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc1f9f8 ffffffffbe1cc4ba 024000c0cdc1f990 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc1f998 ffff953000000010 ffffae59cdc1fa08 ffffae59cdc1f9b8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? finish_task_switch+0x128/0x240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] skb_page_frag_refill+0xd0/0x120 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] sk_page_frag_refill+0x1d/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tcp_sendmsg+0x207/0xc00 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] inet_sendmsg+0x65/0xa0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] sock_sendmsg+0x38/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ___sys_sendmsg+0x2c2/0x2d0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? zone_watermark_ok+0x21/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? handle_mm_fault+0xb9c/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? SYSC_sendto+0x157/0x190 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __fget_light+0x25/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __sys_sendmsg+0x54/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_sendmsg+0x12/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540380kB unevictable:23400kB isolated(anon):284kB isolated(file):504kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892984kB writeback:32kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:130 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42092kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532448kB unevictable:23392kB writepending:6543404kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2893016kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75988kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:56kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1237*4kB (UME) 1833*8kB (UME) 1135*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43180kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 790*4kB (UME) 945*8kB (UME) 771*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45744kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1232 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076484, delete 1075252, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170184kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 12440ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 18908 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683be0 ffffffffbe1cc4ba 025200c2e9683b78 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e9683b80 ffff953000000010 ffffae59e9683bf0 ffffae59e9683ba0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? _raw_spin_unlock_bh+0x1a/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pipe_write+0x1e9/0x410 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:254 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892260kB writeback:652kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1348*4kB (UME) 1834*8kB (UME) 1137*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43664kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 842*4kB (UME) 945*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45936kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1243 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075252, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: reader#4: page allocation stalls for 13135ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 2490 Comm: reader#4 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdf439c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdf43a50 ffffffffbe1cc4ba 024200cacdf439e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdf439f0 ffff952400000010 ffffae59cdf43a60 ffffae59cdf43a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:576 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892260kB writeback:652kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:388 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1358*4kB (UME) 1834*8kB (UME) 1137*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43704kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 849*4kB (UME) 945*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45964kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1243 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075252, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: systemd-journal: page allocation stalls for 10290ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 17 PID: 1649 Comm: systemd-journal Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd937a50 ffffffffbe1cc4ba 024200cacd9379e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379f0 ffff953000000010 ffffae59cd937a60 ffffae59cd937a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? do_syscall_64+0x12d/0x180 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:416 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:448 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1482*4kB (UME) 1840*8kB (UME) 1138*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44264kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 884*4kB (UME) 946*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46112kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 17329ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 19453 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3338f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce333980 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce333920 ffff953000000010 ffffae59ce333990 ffffae59ce333940 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: iscsid: page allocation stalls for 10440ms, order:0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 16 PID: 2041 Comm: iscsid Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839c8 ffffffffbe3f40bd Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce283a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839f0 ffff952400000010 ffffae59ce283a60 ffffae59ce283a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:48942 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? do_nanosleep+0x97/0xf0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1024 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:49454 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*2048kB (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 1829*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 164*128kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB (UH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 4*64kB (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 946*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 770*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 7*128kB (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 16465ms, order:0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 0 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#3: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 10648ms, order:0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879c8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe3f40bd Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UH) 4*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe1cc4ba Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 024200ca00000000 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 0*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffff952400000010 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB (UME) 946*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? schedule+0x36/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? schedule_timeout+0x226/0x3f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 770*16kB (UEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? ktime_get+0x41/0xb0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB (UMEH) 7*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 6 PID: 2484 Comm: writer#3 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2f9c8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe3f40bd Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:2191 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2fa50 ffffffffbe1cc4ba Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:51118 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 024200ca00000000 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2f9f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffff952400000010 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 2931 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2fa60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdd2fa10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? SYSC_sendto+0x157/0x190 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:3087 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:51630 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 2931 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB (UH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 4*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 0*2048kB 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 946*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 770*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 7*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1483*4kB (UME) 1840*8kB (UME) 1138*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44268kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 884*4kB (UME) 946*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46112kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170140kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: warn_alloc: 6 callbacks suppressed Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 11765ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 21 PID: 19719 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9ff780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9ff808 ffffffffbe1cc4ba 024000c0f255aa80 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9ff7a8 0000000000000010 ffffae59cd9ff818 ffffae59cd9ff7c8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? update_load_avg+0x73/0x360 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __pollwait+0x99/0xe0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] datagram_poll+0x29/0x100 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] udp_poll+0x19/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] sock_poll+0x80/0xa0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_sys_poll+0x26e/0x550 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_initwait+0x50/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ppoll+0x170/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? exit_to_usermode_loop+0x90/0xb0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5445249 inactive_anon:578063 isolated_anon:580 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244924kB inactive_anon:1357944kB active_file:28147060kB inactive_file:6538048kB unevictable:23400kB isolated(anon):1304kB isolated(file):2680kB mapped:124184kB dirty:6551180kB writeback:472kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:12523832 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536072kB inactive_anon:954308kB active_file:35339968kB inactive_file:2890944kB unevictable:141172kB isolated(anon):1016kB isolated(file):112kB mapped:67916kB dirty:2892684kB writeback:1068kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1094420 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183872kB min:2732kB low:5732kB high:8732kB active_anon:1894804kB inactive_anon:32152kB active_file:855456kB inactive_file:7848kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2016kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:124kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42560kB min:42256kB low:88648kB high:135040kB active_anon:10350120kB inactive_anon:1325792kB active_file:27291604kB inactive_file:6530108kB unevictable:23392kB writepending:6543712kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:660kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:46176kB min:45104kB low:94624kB high:144144kB active_anon:9536072kB inactive_anon:954308kB active_file:35339968kB inactive_file:2890944kB unevictable:141172kB writepending:2893752kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75988kB kernel_stack:6232kB pagetables:40852kB bounce:0kB free_pcp:1252kB local_pcp:12kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3030*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183872kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1296*4kB (UME) 1820*8kB (UME) 1136*16kB (UMEH) 141*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42560kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 843*4kB (UME) 965*8kB (UME) 778*16kB (UMEH) 385*32kB (UMEH) 123*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46420kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234860 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 826 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076952, delete 1076126, find 2678477/2984177 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8170428kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 15271ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 30 PID: 17529 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e13e38f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e13e3980 ffffffffbe1cc4ba 024000c0e13e3918 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59e13e3920 ffff952400000010 ffffae59e13e3990 ffffae59e13e3940 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444937 inactive_anon:577501 isolated_anon:1066 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244604kB inactive_anon:1356540kB active_file:28147220kB inactive_file:6541656kB unevictable:23400kB isolated(anon):1504kB isolated(file):120kB mapped:124184kB dirty:6552484kB writeback:720kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:704 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535144kB inactive_anon:953464kB active_file:35340024kB inactive_file:2892228kB unevictable:141172kB isolated(anon):2760kB isolated(file):240kB mapped:67916kB dirty:2895276kB writeback:680kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1152 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42020kB min:42256kB low:88648kB high:135040kB active_anon:10349792kB inactive_anon:1324396kB active_file:27291764kB inactive_file:6533716kB unevictable:23392kB writepending:6545264kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44724kB min:45104kB low:94624kB high:144144kB active_anon:9535144kB inactive_anon:953464kB active_file:35340024kB inactive_file:2892228kB unevictable:141172kB writepending:2895956kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76040kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1413*4kB (UME) 1914*8kB (UME) 1138*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43716kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 891*4kB (UME) 960*8kB (UME) 780*16kB (UMEH) 374*32kB (UME) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46060kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235962 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1255 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078176, delete 1076921, find 2678525/2984268 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8168152kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 25931ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 19730 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0a3690 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0a3718 ffffffffbe1cc4ba 024280cace0a36b0 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce0a36b8 ffff953000000010 ffffae59ce0a3728 ffffae59ce0a36d8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x13bd/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_user_pages+0x171/0x730 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] get_user_pages+0x4f/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __gfn_to_pfn_memslot+0x120/0x420 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] try_async_pf+0x66/0x230 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? kvm_host_page_size+0x8a/0xa0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x130/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pgdat_reclaimable+0x6a/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? handle_mm_fault+0xb9c/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:220kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:759 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:660kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1153 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41676kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544652kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44820kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2895000kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:128kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 775*4kB (UME) 979*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 45892kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166608kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 31816ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879f0 ffff952400000010 ffffae59ce887a60 ffffae59ce887a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? ktime_get+0x41/0xb0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:220kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:1147 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:660kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:544 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41676kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544652kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44820kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2895000kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 801*4kB (UME) 982*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46020kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166608kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#0: page allocation stalls for 26009ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 12 PID: 2481 Comm: writer#0 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9679c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce967a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce9679f0 ffff952400000010 ffffae59ce967a60 ffffae59ce967a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:216kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:40971 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:656kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:39397 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41804kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544648kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44824kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2894996kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 801*4kB (UME) 982*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46020kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166608kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 26034ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 28 PID: 19260 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2eb8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2eb980 ffffffffbe1cc4ba 024000c0ce2eb918 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2eb920 ffff953000000010 ffffae59ce2eb990 ffffae59ce2eb940 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? rwsem_down_write_failed_killable+0x1b0/0x3e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444941 inactive_anon:577320 isolated_anon:1021 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244628kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6540860kB unevictable:23400kB isolated(anon):904kB isolated(file):760kB mapped:124184kB dirty:6552372kB writeback:332kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:952912kB active_file:35340028kB inactive_file:2892260kB unevictable:141172kB isolated(anon):3180kB isolated(file):112kB mapped:67916kB dirty:2894340kB writeback:684kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:896 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7904kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42132kB min:42256kB low:88648kB high:135040kB active_anon:10349816kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6532920kB unevictable:23392kB writepending:6544764kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45024kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:952912kB active_file:35340028kB inactive_file:2892260kB unevictable:141172kB writepending:2895024kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1355*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43540kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 828*4kB (UME) 989*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46184kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236025 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1403 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078659, delete 1077256, find 2678525/2984269 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8166604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 42229ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 1 PID: 2520 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16fa50 ffffffffbe1cc4ba 024200cace16f9e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce16f9f0 ffff952400000010 ffffae59ce16fa60 ffffae59ce16fa10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x12a/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42052kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44944kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1390*4kB (UME) 1940*8kB (UME) 1142*16kB (UMEH) 149*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44248kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 929*4kB (UME) 1086*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47380kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1169 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079162, delete 1077993, find 2678579/2984370 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165772kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 20040ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 26 PID: 19454 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce38f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce38f980 ffffffffbe1cc4ba 024000c0ce38f918 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce38f920 ffff953000000010 ffffae59ce38f990 ffffae59ce38f940 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? rwsem_down_write_failed_killable+0x1b0/0x3e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:544 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:411 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42052kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44944kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1458*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44592kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 930*4kB (UME) 1086*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47384kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1154 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079179, delete 1078025, find 2678579/2984370 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165772kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 29063ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 13184 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ced777d8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ced77860 ffffffffbe1cc4ba 024000c0ced777f8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ced77800 ffff952400000010 ffffae59ced77870 ffffae59ced77820 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __pollwait+0x99/0xe0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] eventfd_poll+0x2c/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_sys_poll+0x26e/0x550 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? skb_free_head+0x21/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? skb_release_data+0xf5/0x130 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_initwait+0x50/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ppoll+0x170/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:320 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:257 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42056kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45028kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1493*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44732kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1045*4kB (UME) 1091*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47884kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1120 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079179, delete 1078059, find 2678579/2984371 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165772kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: in:imjournal: page allocation stalls for 20890ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 2006 Comm: in:imjournal Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc87a50 ffffffffbe1cc4ba 024200cacdc879e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdc879f0 ffff953000000010 ffffae59cdc87a60 ffffae59cdc87a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? call_rcu_sched+0x1d/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? dentry_free+0x3c/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __dentry_kill+0xf4/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444652 inactive_anon:576918 isolated_anon:938 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):792kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533512kB inactive_anon:953620kB active_file:35340024kB inactive_file:2892512kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1596kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:282 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42188kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544420kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45036kB min:45104kB low:94624kB high:144144kB active_anon:9533512kB inactive_anon:953620kB active_file:35340024kB inactive_file:2892512kB unevictable:141172kB writepending:2895344kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1510*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44800kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1077*4kB (UME) 1099*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48076kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235993 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1121 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079195, delete 1078074, find 2678579/2984372 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165708kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 38686ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 14 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce887a50 ffffffffbe1cc4ba 024200cace8879e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce8879f0 ffff952400000010 ffffae59ce887a60 ffffae59ce887a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? ktime_get+0x41/0xb0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444639 inactive_anon:576425 isolated_anon:1002 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245556kB inactive_anon:1352652kB active_file:28147220kB inactive_file:6542668kB unevictable:23400kB isolated(anon):448kB isolated(file):1016kB mapped:124236kB dirty:6554580kB writeback:336kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533000kB inactive_anon:953048kB active_file:35340020kB inactive_file:2892348kB unevictable:141172kB isolated(anon):3560kB isolated(file):112kB mapped:67956kB dirty:2894176kB writeback:2228kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7744kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41992kB min:42256kB low:88648kB high:135040kB active_anon:10350744kB inactive_anon:1320508kB active_file:27291764kB inactive_file:6534856kB unevictable:23392kB writepending:6546976kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140516kB kernel_stack:10472kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44644kB min:45104kB low:94624kB high:144144kB active_anon:9533000kB inactive_anon:953048kB active_file:35340020kB inactive_file:2892348kB unevictable:141172kB writepending:2896404kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75944kB kernel_stack:6136kB pagetables:41112kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1032*4kB (UME) 1993*8kB (UME) 1144*16kB (UMEH) 153*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43400kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 500*4kB (UME) 1056*8kB (UME) 785*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 45504kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236422 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079634, delete 1078425, find 2678696/2984501 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8165276kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 35060ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 9 PID: 2283 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce21b9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce21ba50 ffffffffbe1cc4ba 024200cace21b9e8 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce21b9f0 ffff952400000010 ffffae59ce21ba60 ffffae59ce21ba10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pick_next_task_fair+0x324/0x4d0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? sched_clock+0x9/0x10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5420540 inactive_anon:599988 isolated_anon:1226 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12246288kB inactive_anon:1351300kB active_file:28147220kB inactive_file:6543568kB unevictable:23400kB isolated(anon):576kB isolated(file):120kB mapped:124236kB dirty:6554612kB writeback:232kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9435872kB inactive_anon:1048652kB active_file:35340020kB inactive_file:2892320kB unevictable:141172kB isolated(anon):4328kB isolated(file):112kB mapped:68008kB dirty:2894152kB writeback:1872kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42160kB min:42256kB low:88648kB high:135040kB active_anon:10351476kB inactive_anon:1319156kB active_file:27291764kB inactive_file:6535628kB unevictable:23392kB writepending:6546904kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140532kB kernel_stack:10456kB pagetables:75412kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44704kB min:45104kB low:94624kB high:144144kB active_anon:9435872kB inactive_anon:1048652kB active_file:35340020kB inactive_file:2892320kB unevictable:141172kB writepending:2896024kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75920kB kernel_stack:6056kB pagetables:41112kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 838*4kB (UME) 2118*8kB (UME) 1144*16kB (UMEH) 152*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43592kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 679*4kB (UME) 1058*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46252kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236457 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1320 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1080292, delete 1078972, find 2678822/2984731 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8164552kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10475ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 27 PID: 19728 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3cf8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3cf980 ffffffffbe1cc4ba 024000c0ce3cf918 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3cf920 ffff952400000010 ffffae59ce3cf990 ffffae59ce3cf940 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? update_load_avg+0x73/0x360 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __vfs_write+0x37/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:144 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42208kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547312kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140616kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44644kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:16kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 963*4kB (UME) 2112*8kB (UME) 1149*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44060kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1244*4kB (UME) 1010*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1672 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081449, delete 1079777, find 2678822/2984731 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159928kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: iscsid: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 10485ms, order:0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 36153ms, order:0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 31 PID: 2255 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfbb9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfbba50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cdfbb9f0 ffff952400000010 ffffae59cdfbba60 ffffae59cdfbba10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x12a/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 26 PID: 2041 Comm: iscsid Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839c8 ffffffffbe3f40bd ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10410ms, order:0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce283a50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce2839f0 ffff952400000010 ffffae59ce283a60 ffffae59ce283a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? do_nanosleep+0x97/0xf0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 23 PID: 17635 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c7970 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42192kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547312kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c79f8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbe1cc4ba 024000c0ce3c7990 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c7998 ffff953000000010 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c7a08 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 2931 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59ce3c79b8 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:24kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42540kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547308kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] skb_page_frag_refill+0xd0/0x120 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] sk_page_frag_refill+0x1d/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tcp_sendmsg+0x207/0xc00 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] inet_sendmsg+0x65/0xa0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] sock_sendmsg+0x38/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ___sys_sendmsg+0x2c2/0x2d0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44832kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:44kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? eventfd_ctx_read+0x67/0x1b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? poll_select_copy_remaining+0x150/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? wake_up_q+0x80/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? eventfd_read+0x5c/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __vfs_read+0x37/0x150 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? __fget_light+0x25/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __sys_sendmsg+0x54/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_sendmsg+0x12/0x20 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:232kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1280 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1440 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 927*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2931 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UM) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB = 183944kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 966*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 927*32kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2112*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1148*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 152*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42688kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547308kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*128kB 0*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UM) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 183944kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44056kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 966*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:45108kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:172kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 1182*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2112*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1148*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1015*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 786*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 152*32kB (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 379*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 122*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 8*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44056kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1182*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 47920kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1015*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 786*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 379*32kB (UMEH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 8*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1673 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081450, delete 1079777, find 2678822/2984731 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*512kB (MH) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 47920kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 927*32kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 372*64kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1675 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081452, delete 1079777, find 2678822/2984731 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 935*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43932kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1151*4kB (UME) 1015*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47796kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1675 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081452, delete 1079777, find 2678822/2984731 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159924kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 27321ms, order:0, mode:0x24000c0(GFP_KERNEL) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 8 PID: 19621 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f980 ffffffffbe1cc4ba 024000c0cda2f918 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cda2f920 ffff952400000010 ffffae59cda2f990 ffffae59cda2f940 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? set_spte+0x10b/0x340 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __get_free_pages+0x14/0x40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] mmu_topup_memory_caches+0x4c/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] tdp_page_fault+0x53/0x280 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_mmu_page_fault+0x5f/0xf0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_ept_violation+0x8e/0x180 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vmx_handle_exit+0x1ca/0x1430 [kvm_intel] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? kvm_write_guest_cached+0x73/0xd0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? kvm_lapic_sync_from_vapic+0xac/0x170 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] kvm_vcpu_ioctl+0x33c/0x620 [kvm] Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_vfs_ioctl+0xa3/0x5f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_ioctl+0x79/0x90 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419697 inactive_anon:600569 isolated_anon:838 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244156kB inactive_anon:1353116kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1324kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:831 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41948kB min:42256kB low:88648kB high:135040kB active_anon:10349344kB inactive_anon:1320972kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547344kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140628kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB writepending:2896176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 915*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43852kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1292*4kB (UME) 1064*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48752kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237371 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1654 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081546, delete 1079892, find 2678826/2984738 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159560kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 25143ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 19583 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf307b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf307be0 ffffffffbe1cc4ba 025200c200000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cf307b80 ffff952400000010 ffffae59cf307bf0 ffffae59cf307ba0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_current+0x95/0x140 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] pipe_write+0x1e9/0x410 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __vfs_write+0xe5/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] vfs_write+0xb5/0x1a0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] SyS_write+0x55/0xc0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] entry_SYSCALL_64_fastpath+0x1a/0xa9 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419697 inactive_anon:600569 isolated_anon:838 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244156kB inactive_anon:1353116kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:264kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:506 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1260kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:480 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41948kB min:42256kB low:88648kB high:135040kB active_anon:10349344kB inactive_anon:1320972kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547340kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140628kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB writepending:2896112kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:12kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 917*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43860kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1292*4kB (UME) 1065*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48760kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237371 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1654 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081546, delete 1079892, find 2678826/2984738 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8159560kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: systemd-journal: page allocation stalls for 40809ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE) Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 1649 Comm: systemd-journal Not tainted 4.9.5-200.fc25.x86_64 #1 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd937a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: ffffae59cd9379f0 ffff953000000010 ffffae59cd937a60 ffffae59cd937a10 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] dump_stack+0x63/0x86 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] warn_alloc+0x13a/0x170 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_slowpath+0x910/0xb40 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __alloc_pages_nodemask+0x2f1/0x340 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] alloc_pages_vma+0xbe/0x290 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __read_swap_cache_async+0x117/0x1e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] read_swap_cache_async+0x26/0x60 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] swapin_readahead+0x1af/0x220 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? radix_tree_lookup_slot+0x22/0x50 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? find_get_entry+0x20/0x160 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? pagecache_get_page+0x2c/0x2f0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_swap_page+0x2d9/0x7b0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] handle_mm_fault+0x940/0x1610 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] __do_page_fault+0x23e/0x4e0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] do_page_fault+0x30/0x80 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] ? do_syscall_64+0x12d/0x180 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: [] page_fault+0x28/0x30 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info: Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5420052 inactive_anon:599904 isolated_anon:461 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244620kB inactive_anon:1351324kB active_file:28147220kB inactive_file:6543608kB unevictable:23400kB isolated(anon):1160kB isolated(file):760kB mapped:124236kB dirty:6554256kB writeback:640kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:896 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9435588kB inactive_anon:1048292kB active_file:35340800kB inactive_file:2894612kB unevictable:141172kB isolated(anon):684kB isolated(file):240kB mapped:68008kB dirty:2895132kB writeback:1548kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7768kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42204kB min:42256kB low:88648kB high:135040kB active_anon:10349808kB inactive_anon:1319180kB active_file:27291764kB inactive_file:6535668kB unevictable:23392kB writepending:6546956kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140740kB kernel_stack:10536kB pagetables:75420kB bounce:0kB free_pcp:16kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45076kB min:45104kB low:94624kB high:144144kB active_anon:9435588kB inactive_anon:1048292kB active_file:35340800kB inactive_file:2894612kB unevictable:141172kB writepending:2896680kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75968kB kernel_stack:6120kB pagetables:41112kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183996kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1030*4kB (UME) 1986*8kB (UME) 1160*16kB (UME) 160*32kB (UME) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43752kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1017*4kB (UME) 1131*8kB (UME) 783*16kB (UMEH) 380*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48172kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18238165 total pagecache pages Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1671 pages in swap cache Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1083334, delete 1081663, find 2679462/2985930 Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap = 8156400kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned Mar 14 17:22:07 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:22:17 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:22:27 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:22:37 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:22:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:22:57 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: [ERROR] 404 response: Not Found (remaining tries: 0) Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: [ERROR] Job aborted because web UI doesn't accept updates anymore (likely considers this job dead) Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: Mojo::Reactor::Poll: Timer failed: No worker id or webui host set! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 181. Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[34675]: [ERROR] backend crashed ... Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[34675]: killed 19708 - waiting for exit at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 47. Mar 14 17:23:02 qa09.qa.fedoraproject.org worker[5951]: [ERROR] backend crashed ... Mar 14 17:23:02 qa09.qa.fedoraproject.org worker[5951]: killed 19239 - waiting for exit at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 47. Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[5943]: WebUI Mojo::IOLoop=HASH(0x3558158) is unknown! - Should not happen but happened, exiting! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 404. Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[34675]: can't open /var/lib/openqa/pool/6/testresults/result-_do_install_and_reboot.json: No such file or directory at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 735. Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[5943]: [INFO] registering worker with openQA Mojo::IOLoop=HASH(0x3558158)... Mar 14 17:23:04 qa09.qa.fedoraproject.org worker[5838]: [ERROR] 404 response: Not Found (remaining tries: 0) Mar 14 17:23:04 qa09.qa.fedoraproject.org worker[5838]: [ERROR] Job aborted because web UI doesn't accept updates anymore (likely considers this job dead) Mar 14 17:23:05 qa09.qa.fedoraproject.org worker[5838]: Mojo::Reactor::Poll: Timer failed: No worker id or webui host set! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 181. Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[5951]: can't open /var/lib/openqa/pool/9/testresults/result-_do_install_and_reboot.json: No such file or directory at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 735. Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] killing os-autoinst 19708 Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] cleaning up 00079976-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_simple_free_space@uefi Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] got job 79977: 00079977-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-upgrade_minimal_64bit@64bit Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] 20668: WORKING 79977 Mar 14 17:23:07 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] killing os-autoinst 19239 Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] cleaning up 00079743-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_simple_encrypted@uefi Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] got job 79978: 00079978-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_multi_empty@uefi Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] 20674: WORKING 79978 Mar 14 17:23:15 qa09.qa.fedoraproject.org worker[5838]: WebUI Mojo::IOLoop=HASH(0x325d0b0) is unknown! - Should not happen but happened, exiting! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 404. Mar 14 17:23:15 qa09.qa.fedoraproject.org worker[5838]: [INFO] registering worker with openQA Mojo::IOLoop=HASH(0x325d0b0)... Mar 14 17:23:16 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound Mar 14 17:23:16 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound Mar 14 17:23:17 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:23:22 qa09.qa.fedoraproject.org kernel: kvm [20683]: vcpu0, guest rIP: 0xffffffff8805e7e2 unhandled rdmsr: 0x34 Mar 14 17:23:25 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound Mar 14 17:23:25 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound Mar 14 17:23:27 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:23:30 qa09.qa.fedoraproject.org kernel: kvm [20706]: vcpu1, guest rIP: 0xffffffffb3060bd2 unhandled rdmsr: 0x34 Mar 14 17:23:37 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19431 (perl) with signal SIGKILL. Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19433 (/usr/bin/isotov) with signal SIGKILL. Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19434 (/usr/bin/isotov) with signal SIGKILL. Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19435 (/usr/bin/isotov) with signal SIGKILL. Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19438 (videoencoder) with signal SIGKILL. Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19443 (qemu-system-x86) with signal SIGKILL. Mar 14 17:23:41 qa09.qa.fedoraproject.org audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=openqa-worker@8 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Mar 14 17:23:41 qa09.qa.fedoraproject.org audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=openqa-worker@8 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success' Mar 14 17:23:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc: denied { search } for pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0 Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17509 (perl) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17511 (/usr/bin/isotov) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17512 (/usr/bin/isotov) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17514 (/usr/bin/isotov) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17516 (videoencoder) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17519 (qemu-system-x86) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38944 (gstack) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38948 (gdb) with signal SIGKILL. Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38949 (sed) with signal SIGKILL.