Project

General

Profile

wtf.txt

Kernel log from worker host affected by this (jobs 79745 and 79754) around the time workers stopped checking in - AdamWill, 2017-03-14 20:12

 
1
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10023ms, order:0, mode:0x24000c0(GFP_KERNEL)
2
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 13184 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
3
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
4
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  ffffae59ced77780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
5
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  ffffae59ced77808 ffffffffbe1cc4ba 024000c0ced777a0 ffffffffbec50c88
6
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  ffffae59ced777a8 ffff952400000010 ffffae59ced77818 ffffae59ced777c8
7
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Call Trace:
8
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
9
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
10
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
11
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe02fdf9>] ? sched_clock+0x9/0x10
12
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
13
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
14
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
15
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
16
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6e44e9>] datagram_poll+0x29/0x100
17
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe76b6c9>] udp_poll+0x19/0x90
18
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d2580>] sock_poll+0x80/0xa0
19
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
20
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d83ac>] ? __release_sock+0x9c/0xf0
21
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
22
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d848c>] ? release_sock+0x8c/0xa0
23
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
24
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
25
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
26
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
27
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
28
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
29
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
30
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
31
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
32
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
33
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
34
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
35
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Mem-Info:
36
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: active_anon:5416590 inactive_anon:604564 isolated_anon:980
37
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12142708kB inactive_anon:1449936kB active_file:28146220kB inactive_file:6548800kB unevictable:23400kB isolated(anon):1772kB isolated(file):1016kB mapped:124260kB dirty:6556972kB writeback:2352kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 256kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
38
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9523652kB inactive_anon:968320kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB isolated(anon):2148kB isolated(file):368kB mapped:67840kB dirty:2896056kB writeback:1120kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
39
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
40
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
41
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183952kB min:2732kB low:5732kB high:8732kB active_anon:1891120kB inactive_anon:35836kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2020kB kernel_stack:256kB pagetables:780kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
42
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
43
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42016kB min:42256kB low:88648kB high:135040kB active_anon:10251588kB inactive_anon:1414100kB active_file:27290764kB inactive_file:6540864kB unevictable:23392kB writepending:6551388kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140788kB kernel_stack:11080kB pagetables:75540kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
44
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
45
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44688kB min:45104kB low:94624kB high:144144kB active_anon:9523652kB inactive_anon:968320kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB writepending:2897176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76096kB kernel_stack:6120kB pagetables:40796kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
46
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
47
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
48
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3066*4kB (UME) 3321*8kB (UME) 1828*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183984kB
49
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1284*4kB (UME) 1636*8kB (UME) 1124*16kB (UMEH) 196*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42800kB
50
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1471*4kB (UME) 988*8kB (UME) 769*16kB (UMEH) 409*32kB (UMEH) 80*64kB (UMEH) 0*128kB 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45324kB
51
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
52
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
53
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
54
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
55
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 18238526 total pagecache pages
56
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 1314 pages in swap cache
57
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1065298, delete 1063984, find 2675730/2979213
58
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Free swap  = 8188076kB
59
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
60
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
61
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
62
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
63
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
64
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
65
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10404ms, order:0, mode:0x24000c0(GFP_KERNEL)
66
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: CPU: 21 PID: 18924 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
67
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
68
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  ffffae59cced38f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
69
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  ffffae59cced3980 ffffffffbe1cc4ba 024000c0cced3918 ffffffffbec50c88
70
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  ffffae59cced3920 ffff953000000010 ffffae59cced3990 ffffae59cced3940
71
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Call Trace:
72
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
73
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
74
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
75
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
76
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
77
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
78
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
79
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
80
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
81
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
82
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
83
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
84
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
85
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
86
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
87
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
88
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
89
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
90
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
91
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
92
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
93
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Mem-Info:
94
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: active_anon:5416523 inactive_anon:604628 isolated_anon:983
95
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12142704kB inactive_anon:1449928kB active_file:28146220kB inactive_file:6549056kB unevictable:23400kB isolated(anon):1784kB isolated(file):760kB mapped:124260kB dirty:6556972kB writeback:2360kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 256kB writeback_tmp:0kB unstable:0kB pages_scanned:448 all_unreclaimable? no
96
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9523388kB inactive_anon:968584kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB isolated(anon):2148kB isolated(file):368kB mapped:67840kB dirty:2896056kB writeback:1120kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:608 all_unreclaimable? no
97
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
98
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
99
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1891120kB inactive_anon:35836kB active_file:855456kB inactive_file:7552kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2020kB kernel_stack:256kB pagetables:780kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
100
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
101
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42168kB min:42256kB low:88648kB high:135040kB active_anon:10251584kB inactive_anon:1414092kB active_file:27290764kB inactive_file:6541120kB unevictable:23392kB writepending:6551396kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140788kB kernel_stack:11080kB pagetables:75540kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
102
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
103
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44852kB min:45104kB low:94624kB high:144144kB active_anon:9523388kB inactive_anon:968584kB active_file:35339700kB inactive_file:2895308kB unevictable:141172kB writepending:2897176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76096kB kernel_stack:6120kB pagetables:40796kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
104
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
105
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
106
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3066*4kB (UME) 3321*8kB (UME) 1828*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183984kB
107
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1276*4kB (UME) 1636*8kB (UME) 1124*16kB (UMEH) 196*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42768kB
108
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1496*4kB (UME) 988*8kB (UME) 769*16kB (UMEH) 409*32kB (UMEH) 80*64kB (UMEH) 0*128kB 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45424kB
109
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
110
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
111
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
112
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
113
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 18238528 total pagecache pages
114
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 1316 pages in swap cache
115
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1065300, delete 1063984, find 2675731/2979215
116
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Free swap  = 8188068kB
117
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
118
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
119
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
120
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
121
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
122
Mar 14 17:21:48 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
123
Mar 14 17:21:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
124
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: reader#1: page allocation stalls for 13921ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
125
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: CPU: 22 PID: 2487 Comm: reader#1 Not tainted 4.9.5-200.fc25.x86_64 #1
126
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
127
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  ffffae59cddbb9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
128
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  ffffae59cddbba50 ffffffffbe1cc4ba 024200cacddbb9e8 ffffffffbec50c88
129
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  ffffae59cddbb9f0 ffff952400000010 ffffae59cddbba60 ffffae59cddbba10
130
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Call Trace:
131
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
132
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
133
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
134
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
135
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
136
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
137
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
138
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
139
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
140
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
141
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
142
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
143
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
144
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
145
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe272249>] ? dput+0xd9/0x260
146
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe28f4c7>] ? do_statfs_native+0xa7/0xd0
147
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
148
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
149
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
150
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Mem-Info:
151
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: active_anon:5419918 inactive_anon:600157 isolated_anon:886
152
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12151060kB inactive_anon:1439184kB active_file:28146312kB inactive_file:6548092kB unevictable:23400kB isolated(anon):3112kB isolated(file):632kB mapped:124216kB dirty:6557004kB writeback:1236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 200kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
153
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9528612kB inactive_anon:961444kB active_file:35339696kB inactive_file:2895048kB unevictable:141172kB isolated(anon):432kB isolated(file):240kB mapped:67896kB dirty:2895812kB writeback:1064kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:768 all_unreclaimable? no
154
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
155
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
156
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1891504kB inactive_anon:35448kB active_file:855456kB inactive_file:7776kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2016kB kernel_stack:256kB pagetables:784kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
157
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
158
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42172kB min:42256kB low:88648kB high:135040kB active_anon:10259556kB inactive_anon:1403736kB active_file:27290856kB inactive_file:6540152kB unevictable:23392kB writepending:6550300kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375996kB slab_unreclaimable:140680kB kernel_stack:10536kB pagetables:75452kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
159
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
160
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9528612kB inactive_anon:961444kB active_file:35339696kB inactive_file:2895048kB unevictable:141172kB writepending:2896876kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277112kB slab_unreclaimable:76140kB kernel_stack:5992kB pagetables:40756kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
161
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
162
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
163
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184012kB
164
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1408*4kB (UME) 1695*8kB (UME) 1123*16kB (UMEH) 198*32kB (UMEH) 3*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43816kB
165
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1552*4kB (UME) 1087*8kB (UME) 777*16kB (UMEH) 411*32kB (UMEH) 81*64kB (UMEH) 2*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46952kB
166
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
167
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
168
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
169
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
170
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 18238501 total pagecache pages
171
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 1695 pages in swap cache
172
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1067280, delete 1065585, find 2675818/2979365
173
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Free swap  = 8182020kB
174
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
175
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
176
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
177
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
178
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
179
Mar 14 17:21:50 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
180
Mar 14 17:21:57 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
181
Mar 14 17:22:19 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 21494ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
182
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 6 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
183
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
184
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
185
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88
186
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0
187
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
188
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
189
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
190
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
191
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
192
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
193
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
194
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe262729>] pipe_write+0x1e9/0x410
195
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
196
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
197
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
198
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
199
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
200
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442964 inactive_anon:578700 isolated_anon:711
201
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240400kB inactive_anon:1356592kB active_file:28146696kB inactive_file:6544012kB unevictable:23400kB isolated(anon):2344kB isolated(file):888kB mapped:124248kB dirty:6553092kB writeback:884kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
202
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531456kB inactive_anon:958208kB active_file:35339704kB inactive_file:2892108kB unevictable:141172kB isolated(anon):500kB isolated(file):496kB mapped:67916kB dirty:2894744kB writeback:860kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:641 all_unreclaimable? no
203
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
204
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
205
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7780kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
206
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
207
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42156kB min:42256kB low:88648kB high:135040kB active_anon:10345604kB inactive_anon:1324444kB active_file:27291240kB inactive_file:6536076kB unevictable:23392kB writepending:6546040kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
208
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
209
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9531456kB inactive_anon:958208kB active_file:35339704kB inactive_file:2892108kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76120kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
210
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
211
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
212
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
213
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1591*4kB (UME) 1846*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44364kB
214
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 567*4kB (UME) 1343*8kB (UME) 848*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45428kB
215
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
216
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
217
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
218
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
219
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237265 total pagecache pages
220
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1765 pages in swap cache
221
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070652, delete 1068887, find 2677059/2981593
222
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap  = 8179632kB
223
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
224
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
225
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
226
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
227
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
228
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
229
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 15381ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
230
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 23 PID: 19713 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
231
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
232
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59cf71bb60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
233
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59cf71bbe8 ffffffffbe1cc4ba 024280cacf71bb80 ffffffffbec50c88
234
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59cf71bb88 ffff953000000010 ffffae59cf71bbf8 ffffae59cf71bba8
235
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
236
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
237
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
238
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
239
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe126aa9>] ? futex_wait+0xf9/0x260
240
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
241
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
242
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
243
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
244
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
245
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
246
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
247
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442935 inactive_anon:578836 isolated_anon:679
248
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240448kB inactive_anon:1356932kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2344kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:884kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:41 all_unreclaimable? no
249
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958412kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):372kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:892kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
250
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
251
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
252
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7780kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
253
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
254
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345652kB inactive_anon:1324780kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546040kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
255
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
256
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958412kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895600kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
257
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
258
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
259
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
260
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1639*4kB (UME) 1848*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44572kB
261
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 616*4kB (UME) 1344*8kB (UME) 848*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45632kB
262
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
263
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
264
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
265
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
266
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237255 total pagecache pages
267
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1760 pages in swap cache
268
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070662, delete 1068902, find 2677061/2981597
269
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap  = 8179600kB
270
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
271
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
272
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
273
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
274
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
275
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
276
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 11032ms, order:0, mode:0x24000c0(GFP_KERNEL)
277
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 19618 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
278
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
279
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59ce94f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
280
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59ce94f980 ffffffffbe1cc4ba 024000c0ce94f918 ffffffffbec50c88
281
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59ce94f920 ffff952400000010 ffffae59ce94f990 ffffae59ce94f940
282
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
283
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
284
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
285
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 23637ms, order:0
286
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
287
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: , mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
288
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
289
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
290
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
291
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
292
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
293
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
294
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
295
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
296
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
297
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
298
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
299
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
300
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0ce150>] ? wake_up_q+0x80/0x80
301
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
302
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe258f67>] ? __vfs_write+0x37/0x160
303
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
304
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
305
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
306
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
307
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: CPU: 9 PID: 20329 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
308
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
309
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59e164b838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
310
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442947 inactive_anon:578811 isolated_anon:679
311
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59e164b8c0 ffffffffbe1cc4ba 0342004ae164b858 ffffffffbec50c88
312
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  ffffae59e164b860 ffff952400000010 ffffae59e164b8d0 ffffae59e164b880
313
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Call Trace:
314
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240496kB inactive_anon:1356960kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2216kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:1039 all_unreclaimable? no
315
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
316
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
317
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
318
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):500kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
319
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe290e01>] ? alloc_buffer_head+0x21/0x60
320
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
321
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe290e01>] ? alloc_buffer_head+0x21/0x60
322
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
323
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931
324
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
325
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
326
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  48240 48240 48240
327
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
328
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c0e1c>] ? unlock_page+0x4c/0x60
329
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
330
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7772kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
331
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
332
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
333
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0 0
334
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
335
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  45308 45308
336
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
337
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  45308
338
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
339
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345700kB inactive_anon:1324808kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546052kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
340
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
341
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
342
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
343
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
344
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
345
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
346
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0 0
347
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
348
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe230928>] ? __kmalloc+0x168/0x1f0
349
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
350
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe254f6f>] ? __check_object_size+0xff/0x1d6
351
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 
352
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
353
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
354
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
355
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
356
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe258ea6>] do_iter_readv_writev+0xb6/0x140
357
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259b2e>] do_readv_writev+0x19e/0x240
358
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0 0 0
359
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e3d0>] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs]
360
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0cd159>] ? check_preempt_curr+0x79/0x90
361
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0cef6a>] ? wake_up_new_task+0x14a/0x1f0
362
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0af18b>] ? recalc_sigpending+0x1b/0x50
363
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259e1c>] vfs_writev+0x3c/0x50
364
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259fd2>] do_pwritev+0xb2/0xd0
365
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
366
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 
367
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25b0a1>] SyS_pwritev+0x11/0x20
368
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
369
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB 
370
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Mem-Info:
371
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 1*128kB (U) 1*256kB (U) 
372
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: active_anon:5442947 inactive_anon:578811 isolated_anon:679
373
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB 
374
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
375
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB 
376
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240496kB inactive_anon:1356960kB active_file:28146732kB inactive_file:6544104kB unevictable:23400kB isolated(anon):2216kB isolated(file):760kB mapped:124248kB dirty:6553092kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 248kB writeback_tmp:0kB unstable:0kB pages_scanned:1679 all_unreclaimable? no
377
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 
378
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB isolated(anon):500kB isolated(file):624kB mapped:67916kB dirty:2894708kB writeback:896kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:1792 all_unreclaimable? no
379
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*2048kB 
380
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
381
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4096kB = 183988kB
382
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931
383
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 
384
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal: 
385
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  48240
386
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1677*4kB 
387
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME) 
388
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  48240
389
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1855*8kB (UME) 
390
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  48240
391
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1128*16kB 
392
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMEH) 156*32kB 
393
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMH) 
394
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32152kB active_file:855456kB inactive_file:7772kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2128kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
395
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*64kB (H) 
396
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
397
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
398
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*128kB (H) 0*256kB 
399
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
400
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  45308
401
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB 
402
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  45308
403
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  45308
404
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*1024kB 
405
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB 
406
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 
407
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:41868kB min:42256kB low:88648kB high:135040kB active_anon:10345700kB inactive_anon:1324808kB active_file:27291276kB inactive_file:6536168kB unevictable:23392kB writepending:6546052kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375964kB slab_unreclaimable:140776kB kernel_stack:10804kB pagetables:75460kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
408
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: = 44780kB
409
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 
410
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
411
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal: 
412
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
413
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0 0
414
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 719*4kB 
415
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UME) 
416
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
417
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1351*8kB (UME) 
418
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 849*16kB (UMEH) 
419
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 
420
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 377*32kB 
421
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (UMEH) 
422
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Normal free:44836kB min:45104kB low:94624kB high:144144kB active_anon:9531292kB inactive_anon:958284kB active_file:35339704kB inactive_file:2891980kB unevictable:141172kB writepending:2895604kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76124kB kernel_stack:7080kB pagetables:41008kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
423
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 84*64kB (UMEH) 
424
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
425
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0 0
426
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 3*128kB 
427
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
428
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (M) 
429
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
430
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*256kB 
431
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel:  0
432
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB 
433
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB 
434
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (H) 0*2048kB 
435
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 
436
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: DMA: 
437
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4096kB 
438
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: = 46116kB
439
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*4kB 
440
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
441
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
442
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
443
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
444
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*8kB (U) 
445
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 18237241 total pagecache pages
446
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*16kB 
447
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1737 pages in swap cache
448
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070721, delete 1068984, find 2677062/2981599
449
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Free swap  = 8179488kB
450
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 0*32kB 
451
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
452
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 2*64kB (U) 
453
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
454
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
455
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*128kB 
456
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
457
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
458
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: (U) 1*256kB (U) 
459
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
460
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 0*512kB 
461
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
462
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3063*4kB (UME) 3323*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
463
Mar 14 17:23:00 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1677*4kB (UME) 1855*8kB (UME) 1128*16kB (UMEH) 156*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44780kB
464
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 719*4kB (UME) 1351*8kB (UME) 849*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46116kB
465
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
466
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
467
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
468
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
469
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237241 total pagecache pages
470
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1737 pages in swap cache
471
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1070721, delete 1068984, find 2677062/2981599
472
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8179488kB
473
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
474
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
475
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
476
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
477
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
478
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
479
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: in:imjournal: page allocation stalls for 17228ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
480
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 2006 Comm: in:imjournal Not tainted 4.9.5-200.fc25.x86_64 #1
481
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
482
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc878f0 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
483
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc87978 ffffffffbe1cc4ba 0342004acdc87910 ffffffffbec50c88
484
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc87918 ffff953000000010 ffffae59cdc87988 ffffae59cdc87938
485
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
486
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
487
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
488
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
489
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
490
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
491
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
492
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
493
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
494
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
495
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
496
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
497
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
498
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
499
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
500
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
501
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
502
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
503
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
504
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
505
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
506
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
507
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
508
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
509
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443119 inactive_anon:577373 isolated_anon:790
510
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241144kB inactive_anon:1353008kB active_file:28146764kB inactive_file:6545028kB unevictable:23400kB isolated(anon):2696kB isolated(file):504kB mapped:124216kB dirty:6555064kB writeback:640kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:768 all_unreclaimable? no
511
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531332kB inactive_anon:956484kB active_file:35339692kB inactive_file:2892788kB unevictable:141172kB isolated(anon):464kB isolated(file):1008kB mapped:67916kB dirty:2895500kB writeback:612kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:640 all_unreclaimable? no
512
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
513
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
514
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894788kB inactive_anon:32152kB active_file:855456kB inactive_file:7808kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
515
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
516
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42156kB min:42256kB low:88648kB high:135040kB active_anon:10346356kB inactive_anon:1320856kB active_file:27291308kB inactive_file:6537092kB unevictable:23392kB writepending:6547768kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
517
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
518
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44736kB min:45104kB low:94624kB high:144144kB active_anon:9531332kB inactive_anon:956484kB active_file:35339692kB inactive_file:2892788kB unevictable:141172kB writepending:2896112kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
519
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
520
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
521
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB
522
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1026*4kB (UME) 1996*8kB (UME) 1143*16kB (UMEH) 160*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43672kB
523
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 590*4kB (UME) 1436*8kB (UME) 850*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46296kB
524
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
525
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
526
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
527
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
528
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237500 total pagecache pages
529
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1580 pages in swap cache
530
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1071922, delete 1070342, find 2677186/2981768
531
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8178536kB
532
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
533
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
534
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
535
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
536
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
537
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
538
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 14411ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
539
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 19577 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
540
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
541
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cff6f8f0 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
542
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cff6f978 ffffffffbe1cc4ba 0342004acff6f910 ffffffffbec50c88
543
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cff6f918 ffff953000000010 ffffae59cff6f988 ffffae59cff6f938
544
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
545
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
546
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
547
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
548
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
549
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
550
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
551
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
552
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
553
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
554
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
555
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
556
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
557
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
558
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
559
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
560
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
561
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
562
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
563
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
564
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
565
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
566
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
567
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443139 inactive_anon:577355 isolated_anon:646
568
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241248kB inactive_anon:1353192kB active_file:28146764kB inactive_file:6545728kB unevictable:23400kB isolated(anon):2120kB isolated(file):1144kB mapped:124216kB dirty:6553772kB writeback:2900kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:1024 all_unreclaimable? no
569
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531308kB inactive_anon:956228kB active_file:35339704kB inactive_file:2893392kB unevictable:141172kB isolated(anon):464kB isolated(file):1264kB mapped:67916kB dirty:2895648kB writeback:1212kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:1056 all_unreclaimable? no
570
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
571
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
572
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894792kB inactive_anon:32152kB active_file:855456kB inactive_file:7936kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
573
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
574
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42144kB min:42256kB low:88648kB high:135040kB active_anon:10346456kB inactive_anon:1321040kB active_file:27291308kB inactive_file:6537792kB unevictable:23392kB writepending:6548736kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
575
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
576
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9531308kB inactive_anon:956228kB active_file:35339704kB inactive_file:2893392kB unevictable:141172kB writepending:2896860kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
577
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
578
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
579
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB
580
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 913*4kB (UME) 2003*8kB (UME) 1146*16kB (UMEH) 161*32kB (UMH) 1*64kB (H) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43356kB
581
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 492*4kB (UME) 1449*8kB (UME) 852*16kB (UMEH) 377*32kB (UMEH) 84*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46040kB
582
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
583
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
584
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
585
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
586
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237942 total pagecache pages
587
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1533 pages in swap cache
588
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1071983, delete 1070450, find 2677186/2981769
589
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8178292kB
590
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
591
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
592
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
593
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
594
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
595
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
596
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 10849ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
597
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 18908 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
598
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
599
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e9683b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
600
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e9683be0 ffffffffbe1cc4ba 025200c2e9683b78 ffffffffbec50c88
601
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e9683b80 ffff953000000010 ffffae59e9683bf0 ffffae59e9683ba0
602
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
603
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
604
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
605
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
606
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
607
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
608
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe262729>] pipe_write+0x1e9/0x410
609
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
611
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
612
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
613
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
614
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443256 inactive_anon:577228 isolated_anon:517
615
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12241248kB inactive_anon:1353196kB active_file:28146764kB inactive_file:6545728kB unevictable:23400kB isolated(anon):1604kB isolated(file):1144kB mapped:124216kB dirty:6553772kB writeback:4kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 216kB writeback_tmp:0kB unstable:0kB pages_scanned:128 all_unreclaimable? no
616
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9531776kB inactive_anon:955716kB active_file:35339704kB inactive_file:2893212kB unevictable:141172kB isolated(anon):464kB isolated(file):1136kB mapped:67916kB dirty:2895648kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
617
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
618
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
619
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894792kB inactive_anon:32152kB active_file:855456kB inactive_file:7936kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2144kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
620
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
621
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42124kB min:42256kB low:88648kB high:135040kB active_anon:10346456kB inactive_anon:1321044kB active_file:27291308kB inactive_file:6537792kB unevictable:23392kB writepending:6545840kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140792kB kernel_stack:10884kB pagetables:75468kB bounce:0kB free_pcp:116kB local_pcp:0kB free_cma:0kB
622
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
623
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44736kB min:45104kB low:94624kB high:144144kB active_anon:9531776kB inactive_anon:955716kB active_file:35339704kB inactive_file:2893212kB unevictable:141172kB writepending:2895412kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277108kB slab_unreclaimable:76164kB kernel_stack:7064kB pagetables:41016kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
624
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
625
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
626
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3321*8kB (UME) 1822*16kB (UME) 929*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183968kB
627
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1202*4kB (UME) 2093*8kB (UME) 1152*16kB (UMEH) 167*32kB (UMH) 4*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45712kB
628
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 739*4kB (UME) 1464*8kB (UME) 867*16kB (UMEH) 386*32kB (UMEH) 87*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47868kB
629
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
630
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
631
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
632
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
633
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237868 total pagecache pages
634
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1434 pages in swap cache
635
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1072193, delete 1070759, find 2677190/2981777
636
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8177772kB
637
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
638
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
639
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
640
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
641
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
642
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
643
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 33973ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
644
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 20329 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
645
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
646
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e164b838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
647
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e164b8c0 ffffffffbe1cc4ba 0342004ae164b858 ffffffffbec50c88
648
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e164b860 ffff952400000010 ffffae59e164b8d0 ffffae59e164b880
649
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
650
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
651
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
652
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
653
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe290e01>] ? alloc_buffer_head+0x21/0x60
654
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
655
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
656
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
657
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
658
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c0e1c>] ? unlock_page+0x4c/0x60
659
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
660
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
661
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
662
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
663
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
664
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
665
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
666
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
667
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
668
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe230928>] ? __kmalloc+0x168/0x1f0
669
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe254f6f>] ? __check_object_size+0xff/0x1d6
670
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
671
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe258ea6>] do_iter_readv_writev+0xb6/0x140
672
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259b2e>] do_readv_writev+0x19e/0x240
673
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e3d0>] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs]
674
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0cd159>] ? check_preempt_curr+0x79/0x90
675
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0cef6a>] ? wake_up_new_task+0x14a/0x1f0
676
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0af18b>] ? recalc_sigpending+0x1b/0x50
677
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259e1c>] vfs_writev+0x3c/0x50
678
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259fd2>] do_pwritev+0xb2/0xd0
679
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25b0a1>] SyS_pwritev+0x11/0x20
680
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
681
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
682
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
683
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543848kB unevictable:23400kB isolated(anon):2156kB isolated(file):1144kB mapped:124220kB dirty:6554556kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
684
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2895424kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1224 all_unreclaimable? no
685
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
686
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
687
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7512kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
688
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
689
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42040kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535916kB unevictable:23392kB writepending:6545716kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
690
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
691
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
692
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
693
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
694
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1822*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184004kB
695
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1186*4kB (UME) 1837*8kB (UME) 1170*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44112kB
696
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 457*4kB (UME) 1414*8kB (UME) 870*16kB (UMEH) 363*32kB (UMEH) 92*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 45972kB
697
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
698
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
699
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
700
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
701
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
702
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1762 pages in swap cache
703
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073714, delete 1071951, find 2677693/2982671
704
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8176484kB
705
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
706
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
707
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
708
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
709
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
710
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
711
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 13952ms, order:0, mode:0x24000c0(GFP_KERNEL)
712
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 19443 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
713
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
714
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdb47780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
715
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdb47808 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88
716
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdb477a8 ffff953000000010 ffffae59cdb47818 ffffae59cdb477c8
717
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
718
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
719
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
720
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
721
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0dae69>] ? dequeue_entity+0x259/0xba0
722
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
723
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
724
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
725
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
726
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6e44e9>] datagram_poll+0x29/0x100
727
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe76b6c9>] udp_poll+0x19/0x90
728
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d2580>] sock_poll+0x80/0xa0
729
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
730
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22fd21>] ? __slab_free+0xa1/0x2a0
731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
732
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
733
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
734
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
735
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
736
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
737
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
738
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
739
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
740
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
741
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
742
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
743
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
744
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
745
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
746
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:568 all_unreclaimable? no
747
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
748
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
749
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
750
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
751
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42040kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6545716kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
752
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
753
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
754
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
755
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
756
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1822*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184004kB
757
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1290*4kB (UME) 1841*8kB (UME) 1173*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44608kB
758
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 597*4kB (UME) 1427*8kB (UME) 873*16kB (UMEH) 365*32kB (UMEH) 92*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46748kB
759
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
760
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
761
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
762
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
763
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
764
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1653 pages in swap cache
765
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073767, delete 1072114, find 2677693/2982671
766
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8176400kB
767
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
768
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
769
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
770
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
771
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
772
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
773
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 14016ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
774
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 17 PID: 17998 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
775
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
776
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdfa3b60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
777
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdfa3be8 ffffffffbe1cc4ba 024280cacdfa3b80 ffffffffbec50c88
778
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdfa3b88 ffff953000000010 ffffae59cdfa3bf8 ffffae59cdfa3ba8
779
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
780
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
781
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
782
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
783
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe02fdf9>] ? sched_clock+0x9/0x10
784
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
785
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
786
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
787
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
788
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
789
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
790
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
791
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
792
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
793
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:288 all_unreclaimable? no
794
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
795
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
796
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
797
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
798
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
799
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
801
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
802
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
803
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
804
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1289*4kB (UME) 1850*8kB (UME) 1174*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44692kB
805
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 705*4kB (UME) 1441*8kB (UME) 873*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47484kB
806
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
807
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
808
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
809
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
810
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
811
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1598 pages in swap cache
812
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073892, delete 1072294, find 2677694/2982675
813
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8176156kB
814
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
815
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
816
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
817
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
818
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
819
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
820
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 11573ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
821
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 8 PID: 17514 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
822
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
823
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cf33fb60 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
824
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cf33fbe8 ffffffffbe1cc4ba 024280cacf33fb80 ffffffffbec50c88
825
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cf33fb88 ffff952400000010 ffffae59cf33fbf8 ffffae59cf33fba8
826
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
827
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
828
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
829
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
830
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe126aa9>] ? futex_wait+0xf9/0x260
831
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
832
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
833
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
834
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
835
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
836
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
837
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
838
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
839
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
840
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2894700kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:224 all_unreclaimable? no
841
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
842
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
843
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
844
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
845
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
846
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
847
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894864kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
848
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
850
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
851
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1291*4kB (UME) 1850*8kB (UME) 1174*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44700kB
852
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 709*4kB (UME) 1441*8kB (UME) 873*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47500kB
853
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
854
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
855
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
856
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
857
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
858
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1598 pages in swap cache
859
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073892, delete 1072294, find 2677694/2982675
860
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8176156kB
861
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
862
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
863
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
864
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
865
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
866
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
867
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 35229ms, order:0, mode:0x342004a(GFP_NOFS|__GFP_HIGHMEM|__GFP_HARDWALL|__GFP_MOVABLE|__GFP_WRITE)
868
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 24 PID: 20284 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
869
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
870
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cfa53838 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
871
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cfa538c0 ffffffffbe1cc4ba 0342004acfa53858 ffffffffbec50c88
872
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cfa53860 ffff953000000010 ffffae59cfa538d0 ffffae59cfa53880
873
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
874
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
875
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
876
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
877
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd71c>] ? handle_mm_fault+0xb9c/0x1610
878
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
879
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
880
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c168b>] __page_cache_alloc+0xcb/0x100
881
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a95>] pagecache_get_page+0xb5/0x2f0
882
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2cf0>] grab_cache_page_write_begin+0x20/0x40
883
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c1ff1>] iomap_write_begin+0x51/0x130
884
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c22b8>] iomap_write_actor+0xa8/0x180
885
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
886
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2991>] iomap_apply+0xb1/0x130
887
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
888
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2a80>] iomap_file_buffered_write+0x70/0x90
889
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2c2210>] ? iomap_write_end+0x80/0x80
890
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e27e>] xfs_file_buffered_aio_write+0x11e/0x270 [xfs]
891
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe230928>] ? __kmalloc+0x168/0x1f0
892
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe254f6f>] ? __check_object_size+0xff/0x1d6
893
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e4d3>] xfs_file_write_iter+0x103/0x150 [xfs]
894
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe258ea6>] do_iter_readv_writev+0xb6/0x140
895
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259b2e>] do_readv_writev+0x19e/0x240
896
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1285ed>] ? do_futex+0x2dd/0xaf0
897
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc039e3d0>] ? xfs_file_buffered_aio_write+0x270/0x270 [xfs]
898
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
899
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259e1c>] vfs_writev+0x3c/0x50
900
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259fd2>] do_pwritev+0xb2/0xd0
901
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25b0a1>] SyS_pwritev+0x11/0x20
902
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
903
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
904
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:800
905
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553832kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
906
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB isolated(anon):1044kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:972 all_unreclaimable? no
907
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
908
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
909
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
910
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
911
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:12kB local_pcp:0kB free_cma:0kB
912
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
913
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892980kB unevictable:141172kB writepending:2894140kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:36kB local_pcp:0kB free_cma:0kB
914
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
915
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
916
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
917
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1326*4kB (UME) 1862*8kB (UME) 1176*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44968kB
918
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 794*4kB (UME) 1450*8kB (UME) 874*16kB (UMEH) 367*32kB (UMEH) 94*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47928kB
919
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
920
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
921
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
922
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
923
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
924
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1609 pages in swap cache
925
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073924, delete 1072315, find 2677694/2982675
926
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8176028kB
927
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
928
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
929
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
930
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
932
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
933
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 32043ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
934
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
935
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
936
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
937
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88
938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0
939
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
941
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
942
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
943
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
944
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
945
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
946
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe262729>] pipe_write+0x1e9/0x410
947
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
948
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
949
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
950
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
951
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
952
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672
953
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
954
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892468kB unevictable:141172kB isolated(anon):532kB isolated(file):624kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:130 all_unreclaimable? no
955
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
956
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
957
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
958
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
959
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6544268kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
960
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
961
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44608kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892468kB unevictable:141172kB writepending:2894140kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
962
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
963
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
964
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184020kB
965
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1441*4kB (UME) 1869*8kB (UME) 1176*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45484kB
966
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 911*4kB (UME) 1464*8kB (UME) 883*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 48684kB
967
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
968
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
969
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
970
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
971
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
972
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1532 pages in swap cache
973
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1073941, delete 1072409, find 2677694/2982677
974
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8175960kB
975
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
976
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
977
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
978
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
979
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
980
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
981
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 10497ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
982
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 29 PID: 13179 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
983
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
984
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
985
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce9f7be0 ffffffffbe1cc4ba 025200c2ce9f7b78 ffffffffbec50c88
986
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce9f7b80 ffff952400000010 ffffae59ce9f7bf0 ffffae59ce9f7ba0
987
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
988
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
989
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
990
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
991
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
992
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
993
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe262729>] pipe_write+0x1e9/0x410
994
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
995
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
996
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
997
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
998
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
999
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672
1000
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
1001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB isolated(anon):532kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1664 all_unreclaimable? no
1002
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1003
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1004
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1005
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1006
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6543544kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1007
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1008
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45092kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB writepending:2893416kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1009
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1010
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1011
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184024kB
1012
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1533*4kB (UME) 1884*8kB (UME) 1179*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46020kB
1013
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1052*4kB (UME) 1494*8kB (UME) 889*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 49584kB
1014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1015
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1016
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1017
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1018
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
1019
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1503 pages in swap cache
1020
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074084, delete 1072581, find 2677694/2982677
1021
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8175772kB
1022
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1023
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1024
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1025
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1026
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1027
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1028
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10585ms, order:0, mode:0x24000c0(GFP_KERNEL)
1029
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 10 PID: 19621 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
1030
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1031
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cda2f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1032
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cda2f980 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88
1033
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cda2f920 ffff952400000010 ffffae59cda2f990 ffffae59cda2f940
1034
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1035
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1036
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1037
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1038
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
1039
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1040
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
1041
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
1042
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
1043
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
1044
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
1045
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
1046
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
1047
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
1048
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
1049
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
1050
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
1051
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
1052
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81ae80>] ? rwsem_down_write_failed_killable+0x1b0/0x3e0
1053
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
1054
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
1055
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1056
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443732 inactive_anon:577386 isolated_anon:672
1057
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240672kB inactive_anon:1355904kB active_file:28146776kB inactive_file:6543332kB unevictable:23400kB isolated(anon):2156kB isolated(file):1656kB mapped:124220kB dirty:6553108kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 220kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
1058
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB isolated(anon):532kB isolated(file):112kB mapped:67960kB dirty:2893976kB writeback:164kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:528 all_unreclaimable? no
1059
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1060
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1061
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894796kB inactive_anon:32148kB active_file:855456kB inactive_file:7492kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2136kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1062
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1063
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41952kB min:42256kB low:88648kB high:135040kB active_anon:10345876kB inactive_anon:1323756kB active_file:27291320kB inactive_file:6535400kB unevictable:23392kB writepending:6543544kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375952kB slab_unreclaimable:140676kB kernel_stack:10788kB pagetables:75436kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1064
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1065
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45092kB min:45104kB low:94624kB high:144144kB active_anon:9534256kB inactive_anon:953640kB active_file:35339708kB inactive_file:2892952kB unevictable:141172kB writepending:2893416kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277092kB slab_unreclaimable:76124kB kernel_stack:6888kB pagetables:41012kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1066
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1067
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1068
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3322*8kB (UME) 1823*16kB (UME) 930*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184024kB
1069
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1536*4kB (UME) 1884*8kB (UME) 1179*16kB (UMEH) 166*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46032kB
1070
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1054*4kB (UME) 1494*8kB (UME) 889*16kB (UMEH) 366*32kB (UMEH) 95*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 49592kB
1071
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1072
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1073
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1074
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1075
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237157 total pagecache pages
1076
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1503 pages in swap cache
1077
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074084, delete 1072581, find 2677694/2982677
1078
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8175772kB
1079
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1080
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1081
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1082
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1083
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1084
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1085
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 35202ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
1086
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 19244 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
1087
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1088
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1089
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7be0 ffffffffbe1cc4ba 025200c2cd9f7b78 ffffffffbec50c88
1090
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9f7b80 ffff953000000010 ffffae59cd9f7bf0 ffffae59cd9f7ba0
1091
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1092
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1093
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1094
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1095
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
1096
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1097
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
1098
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe262729>] pipe_write+0x1e9/0x410
1099
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
1100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
1101
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
1102
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
1103
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1104
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444748 inactive_anon:578108 isolated_anon:49
1105
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244552kB inactive_anon:1355172kB active_file:28146776kB inactive_file:6537248kB unevictable:23400kB isolated(anon):136kB isolated(file):2808kB mapped:124184kB dirty:6549788kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:128 all_unreclaimable? no
1106
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534440kB inactive_anon:957260kB active_file:35339712kB inactive_file:2889332kB unevictable:141172kB isolated(anon):60kB isolated(file):368kB mapped:67920kB dirty:2890688kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
1107
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1108
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1109
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183932kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32116kB active_file:855456kB inactive_file:7360kB unevictable:8kB writepending:7936kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2080kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1110
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1111
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41776kB min:42256kB low:88648kB high:135040kB active_anon:10349752kB inactive_anon:1323024kB active_file:27291320kB inactive_file:6529312kB unevictable:23392kB writepending:6541244kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375932kB slab_unreclaimable:140816kB kernel_stack:10788kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1112
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1113
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44688kB min:45104kB low:94624kB high:144144kB active_anon:9534440kB inactive_anon:957260kB active_file:35339712kB inactive_file:2889332kB unevictable:141172kB writepending:2890284kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277088kB slab_unreclaimable:76220kB kernel_stack:6728kB pagetables:41004kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1114
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1115
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1116
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183904kB
1117
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1117*4kB (UME) 2071*8kB (UME) 1219*16kB (UMEH) 154*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46108kB
1118
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 580*4kB (UME) 1148*8kB (UME) 975*16kB (UMEH) 405*32kB (UMEH) 96*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47616kB
1119
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1120
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1121
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1122
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1123
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235519 total pagecache pages
1124
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1313 pages in swap cache
1125
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074366, delete 1073053, find 2677773/2982822
1126
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8175132kB
1127
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1128
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1129
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1131
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1132
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1133
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 10401ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1134
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 2520 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
1135
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1136
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce16f9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1137
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce16fa50 ffffffffbe1cc4ba 024200cace16f9e8 ffffffffbec50c88
1138
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce16f9f0 ffff952400000010 ffffae59ce16fa60 ffffae59ce16fa10
1139
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1141
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1142
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1143
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1144
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1145
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1146
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1147
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1148
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe21412a>] swapin_readahead+0x12a/0x220
1149
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1151
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1152
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1153
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1154
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1155
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1156
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443745 inactive_anon:579651 isolated_anon:36
1157
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240860kB inactive_anon:1360408kB active_file:28146776kB inactive_file:6538276kB unevictable:23400kB isolated(anon):128kB isolated(file):3192kB mapped:124184kB dirty:6544508kB writeback:1840kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
1158
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9534120kB inactive_anon:958196kB active_file:35339708kB inactive_file:2886176kB unevictable:141172kB isolated(anon):16kB isolated(file):368kB mapped:67920kB dirty:2882980kB writeback:3388kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 144kB writeback_tmp:0kB unstable:0kB pages_scanned:513 all_unreclaimable? no
1159
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1161
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183920kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32148kB active_file:855456kB inactive_file:7584kB unevictable:8kB writepending:7920kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2112kB kernel_stack:260kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1162
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1163
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42080kB min:42256kB low:88648kB high:135040kB active_anon:10346060kB inactive_anon:1328260kB active_file:27291320kB inactive_file:6530356kB unevictable:23392kB writepending:6538428kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375928kB slab_unreclaimable:140648kB kernel_stack:10772kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1164
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1165
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44732kB min:45104kB low:94624kB high:144144kB active_anon:9534120kB inactive_anon:958196kB active_file:35339708kB inactive_file:2886176kB unevictable:141172kB writepending:2887092kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277088kB slab_unreclaimable:76008kB kernel_stack:6744kB pagetables:41004kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
1166
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1167
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1168
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3069*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183932kB
1169
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1332*4kB (UME) 2009*8kB (UME) 1215*16kB (UMEH) 154*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 46408kB
1170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 558*4kB (UME) 1132*8kB (UME) 1004*16kB (UMEH) 407*32kB (UMEH) 96*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 47928kB
1171
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1172
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1173
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1174
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1175
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234465 total pagecache pages
1176
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1344 pages in swap cache
1177
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074488, delete 1073144, find 2677899/2983053
1178
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8175276kB
1179
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1181
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1182
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1183
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1184
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1185
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: warn_alloc: 1 callbacks suppressed
1186
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 12995ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
1187
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 0 PID: 19619 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
1188
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1189
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdb67690 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1190
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdb67718 ffffffffbe1cc4ba 024280cacdb676b0 ffffffffbec50c88
1191
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdb676b8 ffff952400000010 ffffae59cdb67728 ffffae59cdb676d8
1192
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1193
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1194
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1195
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1196
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1197
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1198
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
1199
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1f7691>] __get_user_pages+0x171/0x730
1200
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1f805f>] get_user_pages+0x4f/0x60
1201
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076a030>] __gfn_to_pfn_memslot+0x120/0x420 [kvm]
1202
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0787846>] try_async_pf+0x66/0x230 [kvm]
1203
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076c1ba>] ? kvm_host_page_size+0x8a/0xa0 [kvm]
1204
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790d20>] tdp_page_fault+0x130/0x280 [kvm]
1205
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
1206
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
1207
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
1208
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
1209
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
1210
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
1211
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
1212
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
1213
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
1214
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
1215
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
1216
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1217
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443218 inactive_anon:581444 isolated_anon:98
1218
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12239420kB inactive_anon:1363496kB active_file:28146964kB inactive_file:6540428kB unevictable:23400kB isolated(anon):136kB isolated(file):248kB mapped:124184kB dirty:6551296kB writeback:28kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:512 all_unreclaimable? no
1219
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533452kB inactive_anon:962280kB active_file:35339912kB inactive_file:2887240kB unevictable:141172kB isolated(anon):256kB isolated(file):240kB mapped:67916kB dirty:2889532kB writeback:1080kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 148kB writeback_tmp:0kB unstable:0kB pages_scanned:674 all_unreclaimable? no
1220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1221
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1222
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183936kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32148kB active_file:855456kB inactive_file:7792kB unevictable:8kB writepending:7920kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2108kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1223
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1224
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41904kB min:42256kB low:88648kB high:135040kB active_anon:10344620kB inactive_anon:1331348kB active_file:27291508kB inactive_file:6532508kB unevictable:23392kB writepending:6543404kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375924kB slab_unreclaimable:140824kB kernel_stack:10664kB pagetables:75424kB bounce:0kB free_pcp:36kB local_pcp:0kB free_cma:0kB
1225
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1226
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44300kB min:45104kB low:94624kB high:144144kB active_anon:9533452kB inactive_anon:962280kB active_file:35339912kB inactive_file:2887240kB unevictable:141172kB writepending:2890612kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277084kB slab_unreclaimable:76524kB kernel_stack:6600kB pagetables:40904kB bounce:0kB free_pcp:136kB local_pcp:0kB free_cma:0kB
1227
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1228
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1229
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3070*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183952kB
1230
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1039*4kB (UME) 1813*8kB (UME) 1145*16kB (UMEH) 168*32kB (UMH) 8*64kB (MH) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42996kB
1231
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 803*4kB (UME) 892*8kB (UME) 862*16kB (UMEH) 433*32kB (UMEH) 113*64kB (UMEH) 3*128kB (M) 0*256kB 0*512kB 1*1024kB (H) 0*2048kB 0*4096kB = 46636kB
1232
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1233
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1234
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1235
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1236
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234194 total pagecache pages
1237
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1112 pages in swap cache
1238
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1074739, delete 1073627, find 2678054/2983360
1239
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8175196kB
1240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1241
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1242
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1243
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1244
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1245
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1246
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#1: page allocation stalls for 11515ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1247
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 2482 Comm: writer#1 Not tainted 4.9.5-200.fc25.x86_64 #1
1248
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1249
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdcc79c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1250
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdcc7a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
1251
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdcc79f0 ffff952400000010 ffffae59cdcc7a60 ffffae59cdcc7a10
1252
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1253
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1254
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1255
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1256
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1257
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1258
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1259
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1260
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1261
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
1262
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1263
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1264
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
1265
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1266
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1267
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4097>] ? SYSC_sendto+0x157/0x190
1268
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1269
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1270
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1271
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1272
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5443734 inactive_anon:580423 isolated_anon:166
1273
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12239472kB inactive_anon:1362784kB active_file:28147060kB inactive_file:6539600kB unevictable:23400kB isolated(anon):264kB isolated(file):2040kB mapped:124184kB dirty:6550600kB writeback:1520kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:7904 all_unreclaimable? no
1274
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535464kB inactive_anon:958908kB active_file:35339968kB inactive_file:2889200kB unevictable:141172kB isolated(anon):400kB isolated(file):112kB mapped:67916kB dirty:2891828kB writeback:436kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
1275
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1276
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1277
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183964kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32156kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7928kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2012kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1278
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1279
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42212kB min:42256kB low:88648kB high:135040kB active_anon:10344672kB inactive_anon:1330628kB active_file:27291604kB inactive_file:6531676kB unevictable:23392kB writepending:6544192kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140692kB kernel_stack:10616kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1280
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1281
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44760kB min:45104kB low:94624kB high:144144kB active_anon:9535464kB inactive_anon:958908kB active_file:35339968kB inactive_file:2889200kB unevictable:141172kB writepending:2892264kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277064kB slab_unreclaimable:76088kB kernel_stack:6488kB pagetables:40892kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1282
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1283
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1284
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183964kB
1285
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1455*4kB (UME) 1819*8kB (UME) 1127*16kB (UMEH) 158*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43844kB
1286
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 840*4kB (UME) 978*8kB (UME) 771*16kB (UMEH) 387*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46400kB
1287
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1288
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1289
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1291
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235423 total pagecache pages
1292
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1489 pages in swap cache
1293
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076439, delete 1074950, find 2678314/2983846
1294
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170360kB
1295
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1296
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1297
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1298
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1299
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1300
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1301
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: NetworkManager: page allocation stalls for 12047ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1302
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 1975 Comm: NetworkManager Not tainted 4.9.5-200.fc25.x86_64 #1
1303
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1304
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce0e79c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1305
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce0e7a50 ffffffffbe1cc4ba 024200cace0e79e8 ffffffffbec50c88
1306
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce0e79f0 ffff953000000010 ffffae59ce0e7a60 ffffae59ce0e7a10
1307
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1309
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1310
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1311
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1312
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1313
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1314
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1315
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1316
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
1317
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1318
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1319
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
1320
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1321
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1322
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1323
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1324
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1325
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1326
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444325 inactive_anon:580396 isolated_anon:70
1327
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240912kB inactive_anon:1362672kB active_file:28147060kB inactive_file:6539752kB unevictable:23400kB isolated(anon):264kB isolated(file):1144kB mapped:124184kB dirty:6550824kB writeback:204kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:64 all_unreclaimable? no
1328
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536388kB inactive_anon:958912kB active_file:35339968kB inactive_file:2889512kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891684kB writeback:624kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
1329
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1330
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1331
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7736kB unevictable:8kB writepending:7928kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2012kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1332
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1333
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42024kB min:42256kB low:88648kB high:135040kB active_anon:10346112kB inactive_anon:1330520kB active_file:27291604kB inactive_file:6531824kB unevictable:23392kB writepending:6543100kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140628kB kernel_stack:10616kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1334
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1335
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44732kB min:45104kB low:94624kB high:144144kB active_anon:9536388kB inactive_anon:958912kB active_file:35339968kB inactive_file:2889512kB unevictable:141172kB writepending:2892308kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76064kB kernel_stack:6488kB pagetables:40892kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1336
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1337
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1338
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3065*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184012kB
1339
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1359*4kB (UME) 1819*8kB (UME) 1127*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43428kB
1340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 732*4kB (UME) 938*8kB (UME) 771*16kB (UMEH) 387*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45648kB
1341
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1342
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1343
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1344
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1345
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235203 total pagecache pages
1346
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1476 pages in swap cache
1347
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076446, delete 1074970, find 2678315/2983848
1348
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170336kB
1349
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1350
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1351
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1352
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1353
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1354
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1355
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 12777ms, order:0, mode:0x24000c0(GFP_KERNEL)
1356
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 31 PID: 17985 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
1357
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1358
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc1f970 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1359
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc1f9f8 ffffffffbe1cc4ba 024000c0cdc1f990 ffffffffbec50c88
1360
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc1f998 ffff953000000010 ffffae59cdc1fa08 ffffae59cdc1f9b8
1361
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1362
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1363
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1364
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1365
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0c97a8>] ? finish_task_switch+0x128/0x240
1366
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1367
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
1368
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d7900>] skb_page_frag_refill+0xd0/0x120
1369
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d81dd>] sk_page_frag_refill+0x1d/0x80
1370
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe74ad87>] tcp_sendmsg+0x207/0xc00
1371
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe7778d5>] inet_sendmsg+0x65/0xa0
1372
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d3a38>] sock_sendmsg+0x38/0x50
1373
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4542>] ___sys_sendmsg+0x2c2/0x2d0
1374
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc2a1>] ? zone_watermark_ok+0x21/0x30
1375
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd71c>] ? handle_mm_fault+0xb9c/0x1610
1376
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4097>] ? SYSC_sendto+0x157/0x190
1377
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe278b35>] ? __fget_light+0x25/0x60
1378
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4e94>] __sys_sendmsg+0x54/0x90
1379
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4ee2>] SyS_sendmsg+0x12/0x20
1380
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
1381
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1382
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1383
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540380kB unevictable:23400kB isolated(anon):284kB isolated(file):504kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
1384
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892984kB writeback:32kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:130 all_unreclaimable? no
1385
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1386
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1387
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1388
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1389
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42092kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532448kB unevictable:23392kB writepending:6543404kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1390
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1391
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2893016kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75988kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:56kB local_pcp:0kB free_cma:0kB
1392
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1393
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1394
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
1395
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1237*4kB (UME) 1833*8kB (UME) 1135*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43180kB
1396
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 790*4kB (UME) 945*8kB (UME) 771*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45744kB
1397
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1398
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1399
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1400
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1401
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
1402
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1232 pages in swap cache
1403
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076484, delete 1075252, find 2678315/2983849
1404
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170184kB
1405
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1406
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1407
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1408
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1409
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1411
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 12440ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
1412
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 18908 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
1413
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1414
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e9683b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1415
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e9683be0 ffffffffbe1cc4ba 025200c2e9683b78 ffffffffbec50c88
1416
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e9683b80 ffff953000000010 ffffae59e9683bf0 ffffae59e9683ba0
1417
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1418
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1419
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1420
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1421
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81c91a>] ? _raw_spin_unlock_bh+0x1a/0x20
1422
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1423
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
1424
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe262729>] pipe_write+0x1e9/0x410
1425
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
1426
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
1427
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
1428
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
1429
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1430
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1431
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:254 all_unreclaimable? no
1432
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892260kB writeback:652kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
1433
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1434
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1435
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1436
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1437
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1438
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1439
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1440
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1441
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1442
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
1443
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1348*4kB (UME) 1834*8kB (UME) 1137*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43664kB
1444
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 842*4kB (UME) 945*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45936kB
1445
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1446
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1447
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1448
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1449
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
1450
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1243 pages in swap cache
1451
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075252, find 2678315/2983849
1452
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170140kB
1453
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1454
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1455
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1456
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1457
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1458
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1459
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: reader#4: page allocation stalls for 13135ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1460
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 2490 Comm: reader#4 Not tainted 4.9.5-200.fc25.x86_64 #1
1461
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1462
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdf439c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1463
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdf43a50 ffffffffbe1cc4ba 024200cacdf439e8 ffffffffbec50c88
1464
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdf439f0 ffff952400000010 ffffae59cdf43a60 ffffae59cdf43a10
1465
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1466
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1467
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1468
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1469
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1470
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1471
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1472
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1473
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1474
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
1475
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1476
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1477
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
1478
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1479
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1480
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1481
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1482
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1483
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1484
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1485
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6551552kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:576 all_unreclaimable? no
1486
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2892260kB writeback:652kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:388 all_unreclaimable? no
1487
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1488
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1489
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1490
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1491
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
1492
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1493
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
1494
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1495
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1496
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
1497
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1358*4kB (UME) 1834*8kB (UME) 1137*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43704kB
1498
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 849*4kB (UME) 945*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 45964kB
1499
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1500
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1501
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1502
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1503
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
1504
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1243 pages in swap cache
1505
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075252, find 2678315/2983849
1506
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170140kB
1507
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1508
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1509
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1510
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1511
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1512
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1513
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: systemd-journal: page allocation stalls for 10290ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1514
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 17 PID: 1649 Comm: systemd-journal Not tainted 4.9.5-200.fc25.x86_64 #1
1515
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1516
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9379c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1517
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd937a50 ffffffffbe1cc4ba 024200cacd9379e8 ffffffffbec50c88
1518
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9379f0 ffff953000000010 ffffae59cd937a60 ffffae59cd937a10
1519
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1520
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1521
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1522
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1523
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1524
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1525
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1526
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1527
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1528
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
1529
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1530
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1531
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
1532
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1533
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1534
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1535
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1536
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe003cdd>] ? do_syscall_64+0x12d/0x180
1537
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1538
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1539
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1540
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:416 all_unreclaimable? no
1541
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:448 all_unreclaimable? no
1542
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1543
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
1544
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1545
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
1546
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1547
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1548
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1549
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1550
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
1551
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3062*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
1552
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1482*4kB (UME) 1840*8kB (UME) 1138*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44264kB
1553
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 884*4kB (UME) 946*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46112kB
1554
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1555
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1556
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1557
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1558
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
1559
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
1560
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
1561
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170140kB
1562
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1563
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1564
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1565
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1566
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1567
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1568
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 17329ms, order:0, mode:0x24000c0(GFP_KERNEL)
1569
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 7 PID: 19453 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
1570
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1571
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3338f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
1572
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce333980 ffffffffbe1cc4ba 024000c000000000 ffffffffbec50c88
1573
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce333920 ffff953000000010 ffffae59ce333990 ffffae59ce333940
1574
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1575
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1576
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1577
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1578
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
1579
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: iscsid: page allocation stalls for 10440ms, order:0
1580
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1581
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1582
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
1583
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
1584
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
1585
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
1586
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
1587
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
1588
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
1589
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
1590
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
1591
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
1592
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
1593
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
1594
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
1595
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
1596
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
1597
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1598
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 16 PID: 2041 Comm: iscsid Not tainted 4.9.5-200.fc25.x86_64 #1
1599
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1600
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce2839c8 ffffffffbe3f40bd
1601
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1602
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbec50c88 0000000000000001
1603
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce283a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
1604
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
1605
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce2839f0 ffff952400000010 ffffae59ce283a60 ffffae59ce283a10
1606
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1607
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1608
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:48942 all_unreclaimable? no
1609
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1611
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1612
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1613
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1614
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1615
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1616
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1617
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1618
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1619
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  2931
1620
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1621
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240 48240
1622
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
1623
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
1624
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1625
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1626
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1627
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
1628
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1629
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1630
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
1631
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1632
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1633
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81b687>] ? do_nanosleep+0x97/0xf0
1634
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1635
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1636
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1637
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1638
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1639
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1640
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1641
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
1642
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1643
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1644
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1645
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1024 all_unreclaimable? no
1646
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0 0 0 0
1647
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 
1648
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:49454 all_unreclaimable? no
1649
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB 
1650
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1651
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1652
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
1653
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1654
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  2931
1655
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB 
1656
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
1657
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*128kB 
1658
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
1659
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
1660
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*256kB 
1661
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
1662
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1663
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1664
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1665
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
1666
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB 
1667
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
1668
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*2048kB (M) 
1669
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1670
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1671
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB 
1672
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1673
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1674
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
1675
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 
1676
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1677
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1678
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB 
1679
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1680
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1681
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1682
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1683
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1684
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB 
1685
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 1829*16kB 
1686
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1687
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1688
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1689
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB (UME) 
1690
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB 
1691
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
1692
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1693
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 164*128kB (UME) 
1694
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1695
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1696
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB 
1697
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1698
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1699
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1700
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1701
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB 
1702
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1703
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1704
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1705
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) 
1706
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 
1707
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB 
1708
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
1709
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
1710
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB 
1711
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
1712
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB
1713
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB (U) 
1714
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1715
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 
1716
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB (U) 
1717
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB 
1718
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1719
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB 
1720
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
1721
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB (UME) 
1722
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB 
1723
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
1724
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB (UMEH) 
1725
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
1726
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB 
1727
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB (UH) 
1728
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
1729
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB 
1730
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 4*64kB (M) 
1731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1732
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB 
1733
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB 
1734
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 
1735
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1736
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB 
1737
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
1738
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
1739
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1740
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 0*2048kB 
1741
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: 
1742
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
1743
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB 
1744
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1745
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB
1746
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
1747
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) 
1748
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 
1749
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB 
1750
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB 
1751
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1752
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1753
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 946*8kB 
1754
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB 
1755
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1756
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1757
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 770*16kB 
1758
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB 
1759
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UEH) 
1760
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB 
1761
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1762
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
1763
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB 
1764
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB (UME) 
1765
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 7*128kB (M) 
1766
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB 
1767
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1768
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB 
1769
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*512kB 
1770
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME) 
1771
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1772
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) 
1773
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB 
1774
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 
1775
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB 
1776
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
1777
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
1778
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: 
1779
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 16465ms, order:0
1780
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB
1781
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1782
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 
1783
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB
1784
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB 
1785
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1786
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1787
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 0 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
1788
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1789
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1790
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1791
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
1792
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB 
1793
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#3: 
1794
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1795
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1796
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 10648ms, order:0
1797
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB 
1798
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce8879c8
1799
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
1800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbe3f40bd
1801
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
1802
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB 
1803
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbec50c88
1804
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
1805
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0000000000000001
1806
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170140kB
1807
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
1808
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1809
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1810
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UH) 4*64kB 
1811
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce887a50
1812
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1813
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbe1cc4ba
1814
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  024200ca00000000
1815
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1816
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbec50c88
1817
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1818
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1819
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB 
1820
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1821
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 0*256kB 
1822
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce8879f0
1823
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffff952400000010
1824
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
1825
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 
1826
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce887a60
1827
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
1828
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce887a10
1829
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
1830
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB
1831
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1832
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
1833
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1834
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 
1835
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1836
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1837
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB (UME) 946*8kB 
1838
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe817f26>] ? schedule+0x36/0x80
1839
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81b366>] ? schedule_timeout+0x226/0x3f0
1840
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 770*16kB (UEH) 
1841
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe11ad81>] ? ktime_get+0x41/0xb0
1842
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB 
1843
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1844
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
1845
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1846
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1847
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB (UMEH) 7*128kB 
1848
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1850
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1851
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB 
1852
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
1853
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1854
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1855
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*512kB 
1856
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1857
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1858
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
1859
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB 
1860
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1861
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 
1862
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1863
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
1864
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1865
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
1866
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1867
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB
1868
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1869
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1870
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 6 PID: 2484 Comm: writer#3 Not tainted 4.9.5-200.fc25.x86_64 #1
1871
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1872
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
1873
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1874
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdd2f9c8
1875
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1876
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbe3f40bd
1877
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
1878
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbec50c88
1879
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
1880
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
1881
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:2191 all_unreclaimable? no
1882
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0000000000000001
1883
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
1884
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
1885
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdd2fa50 ffffffffbe1cc4ba
1886
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170140kB
1887
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:51118 all_unreclaimable? no
1888
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  024200ca00000000
1889
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1890
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbec50c88
1891
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
1892
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdd2f9f0
1893
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
1894
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1895
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
1896
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1897
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
1898
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
1899
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffff952400000010
1900
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
1901
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 2931 48240
1902
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdd2fa60
1903
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdd2fa10
1904
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240 48240
1905
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
1906
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
1907
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1908
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
1909
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1910
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
1911
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
1912
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
1913
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1914
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
1915
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1916
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308 45308
1917
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
1918
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
1919
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
1920
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1921
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
1922
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
1923
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
1924
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
1925
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
1926
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
1927
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
1928
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
1929
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4097>] ? SYSC_sendto+0x157/0x190
1930
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
1931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
1932
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1933
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
1934
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1935
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
1936
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0 0 0 0
1937
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444247 inactive_anon:580287 isolated_anon:75
1939
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 
1940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12240796kB inactive_anon:1362452kB active_file:28147276kB inactive_file:6540252kB unevictable:23400kB isolated(anon):284kB isolated(file):632kB mapped:124184kB dirty:6550828kB writeback:488kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:3087 all_unreclaimable? no
1941
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
1942
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 1*2048kB (M) 3*4096kB 
1943
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB isolated(anon):16kB isolated(file):112kB mapped:67916kB dirty:2891536kB writeback:1376kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:51630 all_unreclaimable? no
1944
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1945
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1946
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
1947
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1948
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1949
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: 
1950
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 2931
1951
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB 
1952
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1953
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
1954
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
1955
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) 
1956
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
1957
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB 
1958
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1959
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1960
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183956kB min:2732kB low:5732kB high:8732kB active_anon:1894800kB inactive_anon:32152kB active_file:855456kB inactive_file:7752kB unevictable:8kB writepending:7932kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:1984kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1961
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB 
1962
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1963
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1964
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1965
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB (UME) 
1966
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1967
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB 
1968
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB 
1969
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1970
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1971
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB 
1972
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1973
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1974
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
1975
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) 
1976
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB 
1977
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1978
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42108kB min:42256kB low:88648kB high:135040kB active_anon:10345996kB inactive_anon:1330300kB active_file:27291820kB inactive_file:6532320kB unevictable:23392kB writepending:6543384kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140504kB kernel_stack:10584kB pagetables:75432kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1979
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 184000kB
1980
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
1981
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
1982
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1983
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 
1984
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0 0
1985
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1483*4kB 
1986
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
1987
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1988
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1840*8kB (UME) 
1989
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
1990
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1138*16kB 
1991
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
1992
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44860kB min:45104kB low:94624kB high:144144kB active_anon:9536192kB inactive_anon:958696kB active_file:35339840kB inactive_file:2889832kB unevictable:141172kB writepending:2892912kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75984kB kernel_stack:6328kB pagetables:40864kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
1993
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 157*32kB (UH) 
1994
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
1995
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 4*64kB 
1996
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1997
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
1998
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
1999
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB 
2000
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 
2002
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2003
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB 
2004
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
2005
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 0*2048kB 0*4096kB 
2006
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
2007
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 
2008
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44268kB
2009
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 
2010
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB 
2011
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB (U) 
2012
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 884*4kB (UME) 
2013
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB 
2014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 946*8kB (UME) 
2015
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2016
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 770*16kB 
2017
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 
2018
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UEH) 
2019
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB 
2020
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 381*32kB (UMEH) 
2021
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2022
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB 
2023
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB 
2024
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 7*128kB 
2025
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2026
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*256kB 
2027
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB (U) 
2028
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
2029
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
2030
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*512kB 
2031
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB (U) 
2032
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 1*1024kB 
2033
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB 
2034
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
2035
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 
2036
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB 
2037
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
2038
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
2039
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
2040
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
2041
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 46112kB
2042
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2043
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 
2044
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2045
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2046
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3062*4kB (UME) 
2047
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2048
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) 
2049
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
2050
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
2051
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1829*16kB 
2052
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
2053
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170140kB
2054
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
2055
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2056
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 926*32kB (UME) 
2057
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2058
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2059
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2060
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB 
2061
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2062
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2063
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 184000kB
2064
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1483*4kB (UME) 1840*8kB (UME) 1138*16kB (UMEH) 157*32kB (UH) 4*64kB (M) 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44268kB
2065
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 884*4kB (UME) 946*8kB (UME) 770*16kB (UEH) 381*32kB (UMEH) 122*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46112kB
2066
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2067
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2068
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2069
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2070
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235183 total pagecache pages
2071
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
2072
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076495, delete 1075286, find 2678315/2983849
2073
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170140kB
2074
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2075
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2076
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2077
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2078
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2079
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2080
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: warn_alloc: 6 callbacks suppressed
2081
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 11765ms, order:0, mode:0x24000c0(GFP_KERNEL)
2082
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 21 PID: 19719 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2083
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2084
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9ff780 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2085
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9ff808 ffffffffbe1cc4ba 024000c0f255aa80 ffffffffbec50c88
2086
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9ff7a8 0000000000000010 ffffae59cd9ff818 ffffae59cd9ff7c8
2087
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2088
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2089
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2090
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2091
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0d5e33>] ? update_load_avg+0x73/0x360
2092
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2093
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
2094
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
2095
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
2096
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6e44e9>] datagram_poll+0x29/0x100
2097
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe76b6c9>] udp_poll+0x19/0x90
2098
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d2580>] sock_poll+0x80/0xa0
2099
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
2100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
2101
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2102
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2103
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2104
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2105
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2106
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2107
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2108
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2109
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2110
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
2111
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0032a0>] ? exit_to_usermode_loop+0x90/0xb0
2112
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2113
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2114
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5445249 inactive_anon:578063 isolated_anon:580
2115
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244924kB inactive_anon:1357944kB active_file:28147060kB inactive_file:6538048kB unevictable:23400kB isolated(anon):1304kB isolated(file):2680kB mapped:124184kB dirty:6551180kB writeback:472kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:12523832 all_unreclaimable? no
2116
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9536072kB inactive_anon:954308kB active_file:35339968kB inactive_file:2890944kB unevictable:141172kB isolated(anon):1016kB isolated(file):112kB mapped:67916kB dirty:2892684kB writeback:1068kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1094420 all_unreclaimable? no
2117
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2118
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2119
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183872kB min:2732kB low:5732kB high:8732kB active_anon:1894804kB inactive_anon:32152kB active_file:855456kB inactive_file:7848kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2016kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:124kB local_pcp:0kB free_cma:0kB
2120
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2121
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42560kB min:42256kB low:88648kB high:135040kB active_anon:10350120kB inactive_anon:1325792kB active_file:27291604kB inactive_file:6530108kB unevictable:23392kB writepending:6543712kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375912kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:660kB local_pcp:0kB free_cma:0kB
2122
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2123
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:46176kB min:45104kB low:94624kB high:144144kB active_anon:9536072kB inactive_anon:954308kB active_file:35339968kB inactive_file:2890944kB unevictable:141172kB writepending:2893752kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75988kB kernel_stack:6232kB pagetables:40852kB bounce:0kB free_pcp:1252kB local_pcp:12kB free_cma:0kB
2124
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2125
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2126
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3030*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183872kB
2127
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1296*4kB (UME) 1820*8kB (UME) 1136*16kB (UMEH) 141*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 42560kB
2128
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 843*4kB (UME) 965*8kB (UME) 778*16kB (UMEH) 385*32kB (UMEH) 123*64kB (UMEH) 7*128kB (M) 1*256kB (M) 1*512kB (M) 1*1024kB (H) 0*2048kB 0*4096kB = 46420kB
2129
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2131
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2132
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2133
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18234860 total pagecache pages
2134
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 826 pages in swap cache
2135
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1076952, delete 1076126, find 2678477/2984177
2136
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8170428kB
2137
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2138
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2139
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2141
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2142
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2143
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 15271ms, order:0, mode:0x24000c0(GFP_KERNEL)
2144
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 30 PID: 17529 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2145
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2146
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e13e38f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2147
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e13e3980 ffffffffbe1cc4ba 024000c0e13e3918 ffffffffbec50c88
2148
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59e13e3920 ffff952400000010 ffffae59e13e3990 ffffae59e13e3940
2149
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2151
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2152
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2153
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
2154
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2155
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
2156
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
2157
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
2158
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
2159
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
2160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
2161
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
2162
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
2163
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
2164
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
2165
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
2166
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] ? __vfs_write+0xe5/0x160
2167
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
2168
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
2169
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2171
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444937 inactive_anon:577501 isolated_anon:1066
2172
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244604kB inactive_anon:1356540kB active_file:28147220kB inactive_file:6541656kB unevictable:23400kB isolated(anon):1504kB isolated(file):120kB mapped:124184kB dirty:6552484kB writeback:720kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:704 all_unreclaimable? no
2173
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535144kB inactive_anon:953464kB active_file:35340024kB inactive_file:2892228kB unevictable:141172kB isolated(anon):2760kB isolated(file):240kB mapped:67916kB dirty:2895276kB writeback:680kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1152 all_unreclaimable? no
2174
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2175
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2176
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2177
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2178
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42020kB min:42256kB low:88648kB high:135040kB active_anon:10349792kB inactive_anon:1324396kB active_file:27291764kB inactive_file:6533716kB unevictable:23392kB writepending:6545264kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2179
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44724kB min:45104kB low:94624kB high:144144kB active_anon:9535144kB inactive_anon:953464kB active_file:35340024kB inactive_file:2892228kB unevictable:141172kB writepending:2895956kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76040kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2181
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2182
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2183
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
2184
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1413*4kB (UME) 1914*8kB (UME) 1138*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43716kB
2185
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 891*4kB (UME) 960*8kB (UME) 780*16kB (UMEH) 374*32kB (UME) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46060kB
2186
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2187
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2188
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2189
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2190
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235962 total pagecache pages
2191
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1255 pages in swap cache
2192
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078176, delete 1076921, find 2678525/2984268
2193
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8168152kB
2194
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2195
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2196
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2197
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2198
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2199
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2200
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 25931ms, order:0, mode:0x24280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO)
2201
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 3 PID: 19730 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2202
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2203
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce0a3690 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2204
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce0a3718 ffffffffbe1cc4ba 024280cace0a36b0 ffffffffbec50c88
2205
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce0a36b8 ffff953000000010 ffffae59ce0a3728 ffffae59ce0a36d8
2206
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2207
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2208
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2209
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2210
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2211
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2212
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fdf3d>] handle_mm_fault+0x13bd/0x1610
2213
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1f7691>] __get_user_pages+0x171/0x730
2214
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1f805f>] get_user_pages+0x4f/0x60
2215
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076a030>] __gfn_to_pfn_memslot+0x120/0x420 [kvm]
2216
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0787846>] try_async_pf+0x66/0x230 [kvm]
2217
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076c1ba>] ? kvm_host_page_size+0x8a/0xa0 [kvm]
2218
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790d20>] tdp_page_fault+0x130/0x280 [kvm]
2219
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
2220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
2221
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
2222
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
2223
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
2224
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
2225
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1da80a>] ? pgdat_reclaimable+0x6a/0x90
2226
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
2227
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
2228
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd71c>] ? handle_mm_fault+0xb9c/0x1610
2229
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
2230
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
2231
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2232
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2233
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021
2234
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:220kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:759 all_unreclaimable? no
2235
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:660kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1153 all_unreclaimable? no
2236
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2237
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2238
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2239
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41676kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544652kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2241
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2242
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44820kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2895000kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:128kB local_pcp:0kB free_cma:0kB
2243
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2244
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2245
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
2246
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB
2247
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 775*4kB (UME) 979*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 45892kB
2248
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2249
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2250
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2251
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2252
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages
2253
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache
2254
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269
2255
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8166608kB
2256
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2257
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2258
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2259
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2260
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2261
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2262
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 31816ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2263
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 20 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
2264
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2265
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce8879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2266
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce887a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
2267
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce8879f0 ffff952400000010 ffffae59ce887a60 ffffae59ce887a10
2268
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2269
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2270
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2271
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2272
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe11ad81>] ? ktime_get+0x41/0xb0
2273
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2274
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2275
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2276
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2277
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2278
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
2279
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2280
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2281
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
2282
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2283
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2284
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2285
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2286
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2287
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2288
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021
2289
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:220kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:1147 all_unreclaimable? no
2290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:660kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:544 all_unreclaimable? no
2291
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2292
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2293
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2294
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2295
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41676kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544652kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2296
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2297
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44820kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2895000kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2298
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2299
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2300
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
2301
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB
2302
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 801*4kB (UME) 982*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46020kB
2303
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2304
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2305
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2306
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2307
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages
2308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache
2309
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269
2310
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8166608kB
2311
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2312
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2313
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2314
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2315
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2316
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2317
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: writer#0: page allocation stalls for 26009ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2318
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 12 PID: 2481 Comm: writer#0 Not tainted 4.9.5-200.fc25.x86_64 #1
2319
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2320
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce9679c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2321
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce967a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
2322
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce9679f0 ffff952400000010 ffffae59ce967a60 ffffae59ce967a10
2323
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2324
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2325
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2326
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2327
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2328
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2329
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2330
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2331
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2332
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
2333
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2334
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2335
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
2336
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2337
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2338
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2339
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2341
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2342
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444940 inactive_anon:577352 isolated_anon:1021
2343
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244624kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6541136kB unevictable:23400kB isolated(anon):1032kB isolated(file):504kB mapped:124184kB dirty:6552372kB writeback:216kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 188kB writeback_tmp:0kB unstable:0kB pages_scanned:40971 all_unreclaimable? no
2344
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB isolated(anon):3052kB isolated(file):240kB mapped:67916kB dirty:2894340kB writeback:656kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:39397 all_unreclaimable? no
2345
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2346
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2347
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2348
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2349
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41804kB min:42256kB low:88648kB high:135040kB active_anon:10349812kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6533196kB unevictable:23392kB writepending:6544648kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2350
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2351
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44824kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:953040kB active_file:35340024kB inactive_file:2892136kB unevictable:141172kB writepending:2894996kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2352
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2353
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2354
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
2355
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1343*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43492kB
2356
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 801*4kB (UME) 982*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46020kB
2357
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2358
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2359
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2360
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2361
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236036 total pagecache pages
2362
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1404 pages in swap cache
2363
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078658, delete 1077254, find 2678525/2984269
2364
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8166608kB
2365
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2366
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2367
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2368
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2369
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2370
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2371
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 26034ms, order:0, mode:0x24000c0(GFP_KERNEL)
2372
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 28 PID: 19260 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2373
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2374
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce2eb8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2375
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce2eb980 ffffffffbe1cc4ba 024000c0ce2eb918 ffffffffbec50c88
2376
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce2eb920 ffff953000000010 ffffae59ce2eb990 ffffae59ce2eb940
2377
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2378
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2379
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2380
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2381
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
2382
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2383
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
2384
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
2385
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
2386
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
2387
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
2388
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
2389
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
2390
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
2391
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
2392
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
2393
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
2394
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
2395
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81ae80>] ? rwsem_down_write_failed_killable+0x1b0/0x3e0
2396
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
2397
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2398
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2399
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444941 inactive_anon:577320 isolated_anon:1021
2400
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244628kB inactive_anon:1356368kB active_file:28147328kB inactive_file:6540860kB unevictable:23400kB isolated(anon):904kB isolated(file):760kB mapped:124184kB dirty:6552372kB writeback:332kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no
2401
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9535136kB inactive_anon:952912kB active_file:35340028kB inactive_file:2892260kB unevictable:141172kB isolated(anon):3180kB isolated(file):112kB mapped:67916kB dirty:2894340kB writeback:684kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:896 all_unreclaimable? no
2402
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2403
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2404
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183960kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7904kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2024kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2405
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2406
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42132kB min:42256kB low:88648kB high:135040kB active_anon:10349816kB inactive_anon:1324224kB active_file:27291872kB inactive_file:6532920kB unevictable:23392kB writepending:6544764kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140528kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2407
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2408
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45024kB min:45104kB low:94624kB high:144144kB active_anon:9535136kB inactive_anon:952912kB active_file:35340028kB inactive_file:2892260kB unevictable:141172kB writepending:2895024kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75808kB kernel_stack:6232kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2409
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2410
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2411
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1829*16kB (UME) 926*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183988kB
2412
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1355*4kB (UME) 1917*8kB (UME) 1140*16kB (UMEH) 138*32kB (UMH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43540kB
2413
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 828*4kB (UME) 989*8kB (UME) 783*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46184kB
2414
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2415
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2416
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2417
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2418
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236025 total pagecache pages
2419
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1403 pages in swap cache
2420
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1078659, delete 1077256, find 2678525/2984269
2421
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8166604kB
2422
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2423
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2424
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2425
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2426
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2427
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2428
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 42229ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2429
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 1 PID: 2520 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
2430
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2431
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce16f9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2432
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce16fa50 ffffffffbe1cc4ba 024200cace16f9e8 ffffffffbec50c88
2433
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce16f9f0 ffff952400000010 ffffae59ce16fa60 ffffae59ce16fa10
2434
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2435
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2436
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2437
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2438
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2439
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2440
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2441
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2442
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2443
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe21412a>] swapin_readahead+0x12a/0x220
2444
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2445
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2446
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2447
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2448
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2449
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2450
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2451
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938
2452
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
2453
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
2454
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2455
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2456
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2457
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2458
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42052kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2459
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2460
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44944kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2461
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2462
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2463
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
2464
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1390*4kB (UME) 1940*8kB (UME) 1142*16kB (UMEH) 149*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44248kB
2465
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 929*4kB (UME) 1086*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47380kB
2466
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2467
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2468
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2469
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2470
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages
2471
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1169 pages in swap cache
2472
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079162, delete 1077993, find 2678579/2984370
2473
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8165772kB
2474
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2475
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2476
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2477
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2478
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2479
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2480
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 20040ms, order:0, mode:0x24000c0(GFP_KERNEL)
2481
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 26 PID: 19454 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2482
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2483
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce38f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2484
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce38f980 ffffffffbe1cc4ba 024000c0ce38f918 ffffffffbec50c88
2485
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce38f920 ffff953000000010 ffffae59ce38f990 ffffae59ce38f940
2486
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2487
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2488
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2489
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2490
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
2491
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2492
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
2493
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
2494
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
2495
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
2496
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
2497
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
2498
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
2499
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
2500
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
2501
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
2502
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
2503
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
2504
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81ae80>] ? rwsem_down_write_failed_killable+0x1b0/0x3e0
2505
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
2506
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2507
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2508
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938
2509
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:544 all_unreclaimable? no
2510
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:411 all_unreclaimable? no
2511
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2512
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2513
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2514
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2515
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42052kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2516
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2517
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44944kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2518
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2519
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2520
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
2521
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1458*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44592kB
2522
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 930*4kB (UME) 1086*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47384kB
2523
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2524
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2525
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2526
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2527
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages
2528
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1154 pages in swap cache
2529
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079179, delete 1078025, find 2678579/2984370
2530
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8165772kB
2531
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2532
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2533
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2534
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2535
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2536
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2537
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 29063ms, order:0, mode:0x24000c0(GFP_KERNEL)
2538
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 13184 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2539
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2540
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ced777d8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2541
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ced77860 ffffffffbe1cc4ba 024000c0ced777f8 ffffffffbec50c88
2542
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ced77800 ffff952400000010 ffffae59ced77870 ffffae59ced77820
2543
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2544
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2545
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2546
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2547
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2548
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
2549
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
2550
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ed09>] __pollwait+0x99/0xe0
2551
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2a6f7c>] eventfd_poll+0x2c/0x60
2552
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2702be>] do_sys_poll+0x26e/0x550
2553
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6db041>] ? skb_free_head+0x21/0x30
2554
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6dd265>] ? skb_release_data+0xf5/0x130
2555
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26ec70>] ? poll_initwait+0x50/0x50
2556
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2557
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2558
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2559
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2560
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2561
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2562
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2563
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2564
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2565
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2708c0>] SyS_ppoll+0x170/0x1a0
2566
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2567
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2568
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444665 inactive_anon:576943 isolated_anon:938
2569
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):920kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:176kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:320 all_unreclaimable? no
2570
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB isolated(anon):2832kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1532kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:257 all_unreclaimable? no
2571
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2572
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2573
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2574
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2575
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42056kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544360kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2576
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2577
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45028kB min:45104kB low:94624kB high:144144kB active_anon:9533564kB inactive_anon:953720kB active_file:35340020kB inactive_file:2892644kB unevictable:141172kB writepending:2895280kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2578
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2579
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2580
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
2581
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1493*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44732kB
2582
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1045*4kB (UME) 1091*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47884kB
2583
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2584
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2585
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2586
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2587
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236012 total pagecache pages
2588
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1120 pages in swap cache
2589
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079179, delete 1078059, find 2678579/2984371
2590
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8165772kB
2591
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2592
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2593
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2594
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2595
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2596
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2597
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: in:imjournal: page allocation stalls for 20890ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2598
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 11 PID: 2006 Comm: in:imjournal Not tainted 4.9.5-200.fc25.x86_64 #1
2599
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2600
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2601
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc87a50 ffffffffbe1cc4ba 024200cacdc879e8 ffffffffbec50c88
2602
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdc879f0 ffff953000000010 ffffae59cdc87a60 ffffae59cdc87a10
2603
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2604
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2605
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2606
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2607
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2608
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2609
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2610
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2611
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2612
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
2613
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2614
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2615
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
2616
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2617
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2618
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe10d45d>] ? call_rcu_sched+0x1d/0x20
2619
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe27116c>] ? dentry_free+0x3c/0x80
2620
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe272124>] ? __dentry_kill+0xf4/0x140
2621
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2622
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2623
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2624
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2625
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444652 inactive_anon:576918 isolated_anon:938
2626
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245096kB inactive_anon:1354052kB active_file:28147220kB inactive_file:6539968kB unevictable:23400kB isolated(anon):792kB isolated(file):1656kB mapped:124224kB dirty:6552124kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no
2627
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533512kB inactive_anon:953620kB active_file:35340024kB inactive_file:2892512kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68024kB dirty:2893748kB writeback:1596kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:282 all_unreclaimable? no
2628
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2629
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2630
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7864kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2631
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2632
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42188kB min:42256kB low:88648kB high:135040kB active_anon:10350284kB inactive_anon:1321908kB active_file:27291764kB inactive_file:6532028kB unevictable:23392kB writepending:6544420kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140536kB kernel_stack:10552kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2633
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2634
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45036kB min:45104kB low:94624kB high:144144kB active_anon:9533512kB inactive_anon:953620kB active_file:35340024kB inactive_file:2892512kB unevictable:141172kB writepending:2895344kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:76000kB kernel_stack:6216kB pagetables:40856kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2635
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2636
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2637
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
2638
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1510*4kB (UME) 1939*8kB (UME) 1143*16kB (UMEH) 151*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44800kB
2639
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1077*4kB (UME) 1099*8kB (UME) 784*16kB (UMEH) 377*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48076kB
2640
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2641
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2642
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2643
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2644
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18235993 total pagecache pages
2645
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1121 pages in swap cache
2646
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079195, delete 1078074, find 2678579/2984372
2647
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8165708kB
2648
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2649
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2650
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2651
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2652
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2653
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2654
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 38686ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2655
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 14 PID: 2222 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
2656
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2657
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce8879c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2658
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce887a50 ffffffffbe1cc4ba 024200cace8879e8 ffffffffbec50c88
2659
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce8879f0 ffff952400000010 ffffae59ce887a60 ffffae59ce887a10
2660
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2661
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2662
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2663
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2664
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe11ad81>] ? ktime_get+0x41/0xb0
2665
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2666
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2667
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2668
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2669
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2670
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
2671
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2672
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2673
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
2674
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2675
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2676
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2677
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2678
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2679
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2680
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5444639 inactive_anon:576425 isolated_anon:1002
2681
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12245556kB inactive_anon:1352652kB active_file:28147220kB inactive_file:6542668kB unevictable:23400kB isolated(anon):448kB isolated(file):1016kB mapped:124236kB dirty:6554580kB writeback:336kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
2682
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9533000kB inactive_anon:953048kB active_file:35340020kB inactive_file:2892348kB unevictable:141172kB isolated(anon):3560kB isolated(file):112kB mapped:67956kB dirty:2894176kB writeback:2228kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
2683
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2684
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2685
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7744kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2686
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2687
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41992kB min:42256kB low:88648kB high:135040kB active_anon:10350744kB inactive_anon:1320508kB active_file:27291764kB inactive_file:6534856kB unevictable:23392kB writepending:6546976kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140516kB kernel_stack:10472kB pagetables:75420kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2688
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2689
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44644kB min:45104kB low:94624kB high:144144kB active_anon:9533000kB inactive_anon:953048kB active_file:35340020kB inactive_file:2892348kB unevictable:141172kB writepending:2896404kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75944kB kernel_stack:6136kB pagetables:41112kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2690
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2691
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2692
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
2693
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1032*4kB (UME) 1993*8kB (UME) 1144*16kB (UMEH) 153*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43400kB
2694
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 500*4kB (UME) 1056*8kB (UME) 785*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 45504kB
2695
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2696
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2697
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2698
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2699
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236422 total pagecache pages
2700
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1209 pages in swap cache
2701
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1079634, delete 1078425, find 2678696/2984501
2702
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8165276kB
2703
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2704
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2705
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2706
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2707
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2708
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2709
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 35060ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2710
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 9 PID: 2283 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
2711
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2712
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce21b9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2713
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce21ba50 ffffffffbe1cc4ba 024200cace21b9e8 ffffffffbec50c88
2714
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce21b9f0 ffff952400000010 ffffae59ce21ba60 ffffae59ce21ba10
2715
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2716
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2717
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2718
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2719
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2720
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2721
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2722
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2723
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2724
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
2725
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2726
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2727
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
2728
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2729
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2730
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0e16e4>] ? pick_next_task_fair+0x324/0x4d0
2731
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe02fdf9>] ? sched_clock+0x9/0x10
2732
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2733
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2734
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2735
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2736
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5420540 inactive_anon:599988 isolated_anon:1226
2737
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12246288kB inactive_anon:1351300kB active_file:28147220kB inactive_file:6543568kB unevictable:23400kB isolated(anon):576kB isolated(file):120kB mapped:124236kB dirty:6554612kB writeback:232kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
2738
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9435872kB inactive_anon:1048652kB active_file:35340020kB inactive_file:2892320kB unevictable:141172kB isolated(anon):4328kB isolated(file):112kB mapped:68008kB dirty:2894152kB writeback:1872kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
2739
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2740
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2741
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183924kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2088kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2742
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2743
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42160kB min:42256kB low:88648kB high:135040kB active_anon:10351476kB inactive_anon:1319156kB active_file:27291764kB inactive_file:6535628kB unevictable:23392kB writepending:6546904kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140532kB kernel_stack:10456kB pagetables:75412kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2744
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2745
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44704kB min:45104kB low:94624kB high:144144kB active_anon:9435872kB inactive_anon:1048652kB active_file:35340020kB inactive_file:2892320kB unevictable:141172kB writepending:2896024kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75920kB kernel_stack:6056kB pagetables:41112kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
2746
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2747
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2748
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3059*4kB (UME) 3323*8kB (UME) 1823*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183924kB
2749
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 838*4kB (UME) 2118*8kB (UME) 1144*16kB (UMEH) 152*32kB (UMEH) 0*64kB 1*128kB (H) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43592kB
2750
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 679*4kB (UME) 1058*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 46252kB
2751
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2752
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2753
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2754
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2755
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18236457 total pagecache pages
2756
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1320 pages in swap cache
2757
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1080292, delete 1078972, find 2678822/2984731
2758
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8164552kB
2759
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2760
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2761
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2762
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2763
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2764
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2765
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10475ms, order:0, mode:0x24000c0(GFP_KERNEL)
2766
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 27 PID: 19728 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2767
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2768
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3cf8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2769
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3cf980 ffffffffbe1cc4ba 024000c0ce3cf918 ffffffffbec50c88
2770
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3cf920 ffff952400000010 ffffae59ce3cf990 ffffae59ce3cf940
2771
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2772
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2773
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2774
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2775
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
2776
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2777
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
2778
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
2779
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
2780
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
2781
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
2782
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
2783
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
2784
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4b7ef>] ? atomic_switch_perf_msrs+0x6f/0xa0 [kvm_intel]
2785
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4c2d1>] ? vmx_vcpu_run+0x2d1/0x490 [kvm_intel]
2786
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
2787
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0d5e33>] ? update_load_avg+0x73/0x360
2788
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
2789
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe258f67>] ? __vfs_write+0x37/0x160
2790
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
2791
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
2792
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2793
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2794
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
2795
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
2796
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:144 all_unreclaimable? no
2797
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2798
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
2799
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2800
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
2801
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42208kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547312kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140616kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
2802
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2803
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44644kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:16kB local_pcp:0kB free_cma:0kB
2804
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
2805
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
2806
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
2807
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 963*4kB (UME) 2112*8kB (UME) 1149*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 44060kB
2808
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1244*4kB (UME) 1010*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48128kB
2809
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2810
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2811
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
2812
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2813
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
2814
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1672 pages in swap cache
2815
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081449, delete 1079777, find 2678822/2984731
2816
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8159928kB
2817
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
2818
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
2819
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
2820
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
2821
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
2822
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
2823
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: iscsid: 
2824
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: httpd: page allocation stalls for 10485ms, order:0
2825
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: page allocation stalls for 36153ms, order:0
2826
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2827
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 31 PID: 2255 Comm: httpd Not tainted 4.9.5-200.fc25.x86_64 #1
2828
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
2829
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2830
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdfbb9c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2831
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdfbba50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
2832
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cdfbb9f0 ffff952400000010 ffffae59cdfbba60 ffffae59cdfbba10
2833
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2834
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2835
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2836
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2837
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2838
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2839
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2840
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2841
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2842
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe21412a>] swapin_readahead+0x12a/0x220
2843
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2844
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2845
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] ? do_page_fault+0x30/0x80
2846
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2847
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2848
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2849
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2850
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2851
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 26 PID: 2041 Comm: iscsid Not tainted 4.9.5-200.fc25.x86_64 #1
2852
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2853
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce2839c8 ffffffffbe3f40bd ffffffffbec50c88
2854
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
2855
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 10410ms, order:0
2856
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0000000000000001
2857
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
2858
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce283a50
2859
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: , mode:0x24000c0(GFP_KERNEL)
2860
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
2861
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce2839f0 ffff952400000010 ffffae59ce283a60 ffffae59ce283a10
2862
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2863
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
2864
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2865
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2866
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2867
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2868
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
2869
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2870
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
2871
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  2931 48240
2872
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2873
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
2874
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240 48240
2875
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
2876
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
2877
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
2878
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
2879
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2880
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
2881
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
2882
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
2883
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2884
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
2885
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81b687>] ? do_nanosleep+0x97/0xf0
2886
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2887
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
2888
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
2889
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
2890
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
2891
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
2892
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2893
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 23 PID: 17635 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
2894
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
2895
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
2896
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
2897
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3c7970
2898
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
2899
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
2900
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42192kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547312kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
2901
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3c79f8
2902
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:236kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:256 all_unreclaimable? no
2903
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbe1cc4ba 024000c0ce3c7990
2904
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0
2905
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:384 all_unreclaimable? no
2906
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffffffbec50c88
2907
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
2908
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2909
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3c7998 ffff953000000010
2910
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2911
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3c7a08
2912
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2913
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2914
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
2915
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 2931
2916
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59ce3c79b8
2917
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
2918
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240 48240
2919
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:44652kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:24kB local_pcp:0kB free_cma:0kB
2920
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
2921
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
2922
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
2923
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
2924
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2925
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2926
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2927
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
2928
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2929
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
2930
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2931
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
2932
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2933
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
2934
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
2935
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
2936
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
2937
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
2938
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
2939
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
2940
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42540kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547308kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
2941
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d7900>] skb_page_frag_refill+0xd0/0x120
2942
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
2943
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2944
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 
2945
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2946
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB 
2947
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d81dd>] sk_page_frag_refill+0x1d/0x80
2948
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB 
2949
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe74ad87>] tcp_sendmsg+0x207/0xc00
2950
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2951
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB 
2952
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2953
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2954
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
2955
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe7778d5>] inet_sendmsg+0x65/0xa0
2956
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 
2957
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
2958
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB (U) 
2959
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d3a38>] sock_sendmsg+0x38/0x50
2960
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB 
2961
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4542>] ___sys_sendmsg+0x2c2/0x2d0
2962
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2963
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:44832kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:44kB local_pcp:0kB free_cma:0kB
2964
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2965
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0
2966
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2967
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2968
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB 
2969
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2970
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2a73c7>] ? eventfd_ctx_read+0x67/0x1b0
2971
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
2972
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26f010>] ? poll_select_copy_remaining+0x150/0x150
2973
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe0ce150>] ? wake_up_q+0x80/0x80
2974
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
2975
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2a756c>] ? eventfd_read+0x5c/0x90
2976
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
2977
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB 
2978
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
2979
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB 
2980
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2585d7>] ? __vfs_read+0x37/0x150
2981
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
2982
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe278b35>] ? __fget_light+0x25/0x60
2983
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4e94>] __sys_sendmsg+0x54/0x90
2984
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
2985
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe6d4ee2>] SyS_sendmsg+0x12/0x20
2986
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB 
2987
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
2988
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) = 15896kB
2989
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 
2990
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
2991
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB 
2992
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB (U) 
2993
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: 
2994
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
2995
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB 
2996
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB (U) 
2997
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419694 inactive_anon:600592 isolated_anon:852
2998
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
2999
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 2*64kB 
3000
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB 
3001
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3002
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244152kB inactive_anon:1353112kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:232kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:1280 all_unreclaimable? no
3003
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*128kB 
3004
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB (UME) 
3005
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB isolated(anon):3016kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1704kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:1440 all_unreclaimable? no
3006
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 927*32kB 
3007
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3008
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
3009
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB 
3010
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB (U) 
3011
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
3012
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
3013
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB 
3014
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3015
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 1*2048kB 
3016
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3017
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
3018
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB 
3019
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB 
3020
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
3021
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB 
3022
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
3023
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3024
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3025
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  2931
3026
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
3027
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
3028
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 
3029
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB 
3030
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB 
3031
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3032
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB 
3033
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
3034
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UM) 
3035
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  48240
3036
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3037
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
3038
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB 
3039
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3040
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
3041
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB 
3042
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB = 183944kB
3043
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7940kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3044
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
3045
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 
3046
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3047
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 966*4kB 
3048
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 927*32kB (UME) 
3049
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
3050
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 372*64kB 
3051
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3052
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3053
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3054
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
3055
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2112*8kB (UME) 
3056
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3057
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1148*16kB 
3058
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB 
3059
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3060
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
3061
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 78*256kB 
3062
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  45308
3063
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
3064
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
3065
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 152*32kB 
3066
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
3067
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3068
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*64kB 
3069
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME) 
3070
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:42688kB min:42256kB low:88648kB high:135040kB active_anon:10349340kB inactive_anon:1320968kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547308kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140632kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
3071
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB 
3072
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
3073
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3074
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 
3075
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3076
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*128kB 0*256kB 
3077
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UM) 
3078
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
3079
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
3080
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
3081
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3082
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 183944kB
3083
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
3084
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 
3085
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 
3086
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4096kB 
3087
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
3088
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44056kB
3089
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 966*4kB 
3090
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
3091
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
3092
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal free:45108kB min:45104kB low:94624kB high:144144kB active_anon:9434624kB inactive_anon:1049256kB active_file:35340052kB inactive_file:2892736kB unevictable:141172kB writepending:2896556kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:172kB local_pcp:0kB free_cma:0kB
3093
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 1182*4kB 
3094
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3095
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3096
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2112*8kB 
3097
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3098
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]:
3099
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1148*16kB 
3100
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0 0
3101
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1015*8kB 
3102
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3103
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3104
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 786*16kB 
3105
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
3106
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
3107
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 152*32kB (UMEH) 
3108
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3109
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*64kB 
3110
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  0
3111
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 379*32kB 
3112
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
3113
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 122*64kB 
3114
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (H) 
3115
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3116
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*128kB 
3117
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*256kB 
3118
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA: 
3119
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
3120
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*4kB 
3121
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 8*128kB 
3122
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*8kB 
3123
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) 
3124
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
3125
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*16kB 
3126
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 
3127
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
3128
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB 
3129
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*256kB 
3130
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 44056kB
3131
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) 
3132
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*512kB 
3133
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*32kB 
3134
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) 
3135
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*64kB (U) 
3136
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 
3137
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*128kB 
3138
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Normal: 
3139
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 
3140
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1182*4kB 
3141
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB 
3142
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
3143
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 47920kB
3144
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*256kB 
3145
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
3146
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3147
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*512kB 
3148
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1015*8kB (UME) 
3149
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3150
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 786*16kB 
3151
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UMEH) 
3152
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*1024kB 
3153
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 379*32kB (UMEH) 
3154
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3155
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 122*64kB 
3156
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3157
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3158
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (U) 
3159
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
3160
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1*2048kB (M) 
3161
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3162
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3*4096kB 
3163
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 8*128kB 
3164
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) 
3165
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1673 pages in swap cache
3166
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*256kB 
3167
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081450, delete 1079777, find 2678822/2984731
3168
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8159924kB
3169
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (M) 
3170
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
3171
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
3172
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (MH) 
3173
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
3174
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 2*512kB (MH) 
3175
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 15896kB
3176
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*1024kB 
3177
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 
3178
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: DMA32: 
3179
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
3180
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3060*4kB 
3181
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
3182
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
3183
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0*2048kB 0*4096kB 
3184
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3185
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: = 47920kB
3186
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3187
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 3323*8kB (UME) 
3188
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3189
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3190
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1824*16kB 
3191
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 927*32kB 
3192
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3193
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
3194
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 372*64kB 
3195
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1675 pages in swap cache
3196
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3197
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 164*128kB 
3198
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081452, delete 1079777, find 2678822/2984731
3199
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8159924kB
3200
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
3201
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
3202
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 78*256kB 
3203
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
3204
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: (UME) 
3205
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
3206
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 24*512kB (UME) 
3207
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
3208
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
3209
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
3210
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 935*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43932kB
3211
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1151*4kB (UME) 1015*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 47796kB
3212
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3213
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3214
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3215
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3216
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237340 total pagecache pages
3217
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1675 pages in swap cache
3218
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081452, delete 1079777, find 2678822/2984731
3219
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8159924kB
3220
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
3221
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
3222
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
3223
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
3224
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
3225
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
3226
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: qemu-system-x86: page allocation stalls for 27321ms, order:0, mode:0x24000c0(GFP_KERNEL)
3227
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 8 PID: 19621 Comm: qemu-system-x86 Not tainted 4.9.5-200.fc25.x86_64 #1
3228
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
3229
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cda2f8f8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
3230
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cda2f980 ffffffffbe1cc4ba 024000c0cda2f918 ffffffffbec50c88
3231
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cda2f920 ffff952400000010 ffffae59cda2f990 ffffae59cda2f940
3232
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
3233
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
3234
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
3235
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
3236
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0789acb>] ? set_spte+0x10b/0x340 [kvm]
3237
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
3238
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
3239
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c8304>] __get_free_pages+0x14/0x40
3240
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc078a61c>] mmu_topup_memory_caches+0x4c/0xf0 [kvm]
3241
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0790c43>] tdp_page_fault+0x53/0x280 [kvm]
3242
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07897bf>] kvm_mmu_page_fault+0x5f/0xf0 [kvm]
3243
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e413fe>] handle_ept_violation+0x8e/0x180 [kvm_intel]
3244
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc1e4826a>] vmx_handle_exit+0x1ca/0x1430 [kvm_intel]
3245
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07687f3>] ? kvm_write_guest_cached+0x73/0xd0 [kvm]
3246
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07a31ac>] ? kvm_lapic_sync_from_vapic+0xac/0x170 [kvm]
3247
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc0784590>] kvm_arch_vcpu_ioctl_run+0x7e0/0x16b0 [kvm]
3248
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc07781ba>] ? kvm_put_guest_fpu.part.162+0x4a/0xe0 [kvm]
3249
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffc076983c>] kvm_vcpu_ioctl+0x33c/0x620 [kvm]
3250
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26de03>] do_vfs_ioctl+0xa3/0x5f0
3251
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe26e3c9>] SyS_ioctl+0x79/0x90
3252
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
3253
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
3254
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419697 inactive_anon:600569 isolated_anon:838
3255
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244156kB inactive_anon:1353116kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:268kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:800 all_unreclaimable? no
3256
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1324kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:831 all_unreclaimable? no
3257
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3258
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
3259
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3260
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
3261
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41948kB min:42256kB low:88648kB high:135040kB active_anon:10349344kB inactive_anon:1320972kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547344kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140628kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
3262
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
3263
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB writepending:2896176kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
3264
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
3265
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
3266
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
3267
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 915*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43852kB
3268
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1292*4kB (UME) 1064*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48752kB
3269
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3270
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3271
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3272
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3273
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237371 total pagecache pages
3274
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1654 pages in swap cache
3275
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081546, delete 1079892, find 2678826/2984738
3276
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8159560kB
3277
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
3278
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
3279
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
3280
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
3281
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
3282
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
3283
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: /usr/bin/isotov: page allocation stalls for 25143ms, order:0, mode:0x25200c2(GFP_HIGHUSER|__GFP_ACCOUNT)
3284
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 4 PID: 19583 Comm: /usr/bin/isotov Not tainted 4.9.5-200.fc25.x86_64 #1
3285
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
3286
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cf307b58 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
3287
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cf307be0 ffffffffbe1cc4ba 025200c200000000 ffffffffbec50c88
3288
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cf307b80 ffff952400000010 ffffae59cf307bf0 ffffae59cf307ba0
3289
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
3290
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
3291
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
3292
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
3293
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
3294
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe223255>] alloc_pages_current+0x95/0x140
3295
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe262729>] pipe_write+0x1e9/0x410
3296
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe259015>] __vfs_write+0xe5/0x160
3297
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2598a5>] vfs_write+0xb5/0x1a0
3298
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe25ad05>] SyS_write+0x55/0xc0
3299
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81cc77>] entry_SYSCALL_64_fastpath+0x1a/0xa9
3300
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
3301
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5419697 inactive_anon:600569 isolated_anon:838
3302
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244156kB inactive_anon:1353116kB active_file:28147220kB inactive_file:6544012kB unevictable:23400kB isolated(anon):392kB isolated(file):120kB mapped:124236kB dirty:6555016kB writeback:264kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:506 all_unreclaimable? no
3303
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB isolated(anon):2960kB isolated(file):112kB mapped:68008kB dirty:2894852kB writeback:1260kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:480 all_unreclaimable? no
3304
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3305
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
3306
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183940kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7908kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3307
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
3308
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:41948kB min:42256kB low:88648kB high:135040kB active_anon:10349344kB inactive_anon:1320972kB active_file:27291764kB inactive_file:6536072kB unevictable:23392kB writepending:6547340kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140628kB kernel_stack:10520kB pagetables:75420kB bounce:0kB free_pcp:8kB local_pcp:0kB free_cma:0kB
3309
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
3310
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45016kB min:45104kB low:94624kB high:144144kB active_anon:9434632kB inactive_anon:1049160kB active_file:35340056kB inactive_file:2892732kB unevictable:141172kB writepending:2896112kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75912kB kernel_stack:6120kB pagetables:41116kB bounce:0kB free_pcp:12kB local_pcp:0kB free_cma:0kB
3311
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
3312
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
3313
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3060*4kB (UME) 3323*8kB (UME) 1824*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183944kB
3314
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 917*4kB (UME) 2112*8kB (UME) 1148*16kB (UMEH) 152*32kB (UMEH) 1*64kB (H) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43860kB
3315
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1292*4kB (UME) 1065*8kB (UME) 786*16kB (UMEH) 379*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48760kB
3316
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3317
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3318
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3319
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3320
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18237371 total pagecache pages
3321
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1654 pages in swap cache
3322
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1081546, delete 1079892, find 2678826/2984738
3323
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8159560kB
3324
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
3325
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
3326
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
3327
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
3328
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
3329
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
3330
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: systemd-journal: page allocation stalls for 40809ms, order:0, mode:0x24200ca(GFP_HIGHUSER_MOVABLE)
3331
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: CPU: 15 PID: 1649 Comm: systemd-journal Not tainted 4.9.5-200.fc25.x86_64 #1
3332
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Hardware name: Dell Inc. PowerEdge R520/08DM12, BIOS 2.1.2 01/20/2014
3333
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9379c8 ffffffffbe3f40bd ffffffffbec50c88 0000000000000001
3334
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd937a50 ffffffffbe1cc4ba 024200ca00000000 ffffffffbec50c88
3335
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  ffffae59cd9379f0 ffff953000000010 ffffae59cd937a60 ffffae59cd937a10
3336
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Call Trace:
3337
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3f40bd>] dump_stack+0x63/0x86
3338
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cc4ba>] warn_alloc+0x13a/0x170
3339
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cce70>] __alloc_pages_slowpath+0x910/0xb40
3340
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1cd391>] __alloc_pages_nodemask+0x2f1/0x340
3341
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe22528e>] alloc_pages_vma+0xbe/0x290
3342
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
3343
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213ed7>] __read_swap_cache_async+0x117/0x1e0
3344
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe213fc6>] read_swap_cache_async+0x26/0x60
3345
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe2141af>] swapin_readahead+0x1af/0x220
3346
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe3fa062>] ? radix_tree_lookup_slot+0x22/0x50
3347
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c1ee0>] ? find_get_entry+0x20/0x160
3348
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1c2a0c>] ? pagecache_get_page+0x2c/0x2f0
3349
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fbdc9>] do_swap_page+0x2d9/0x7b0
3350
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe1fd4c0>] handle_mm_fault+0x940/0x1610
3351
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe06280e>] __do_page_fault+0x23e/0x4e0
3352
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe062ae0>] do_page_fault+0x30/0x80
3353
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe003cdd>] ? do_syscall_64+0x12d/0x180
3354
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel:  [<ffffffffbe81e148>] page_fault+0x28/0x30
3355
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Mem-Info:
3356
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: active_anon:5420052 inactive_anon:599904 isolated_anon:461
3357
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 active_anon:12244620kB inactive_anon:1351324kB active_file:28147220kB inactive_file:6543608kB unevictable:23400kB isolated(anon):1160kB isolated(file):760kB mapped:124236kB dirty:6554256kB writeback:640kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 7546880kB anon_thp: 184kB writeback_tmp:0kB unstable:0kB pages_scanned:896 all_unreclaimable? no
3358
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 active_anon:9435588kB inactive_anon:1048292kB active_file:35340800kB inactive_file:2894612kB unevictable:141172kB isolated(anon):684kB isolated(file):240kB mapped:68008kB dirty:2895132kB writeback:1548kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 4761600kB anon_thp: 140kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
3359
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA free:15896kB min:12kB low:24kB high:36kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3360
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 2931 48240 48240 48240
3361
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32 free:183948kB min:2732kB low:5732kB high:8732kB active_anon:1894812kB inactive_anon:32144kB active_file:855456kB inactive_file:7768kB unevictable:8kB writepending:7940kB present:3083200kB managed:3017632kB mlocked:8kB slab_reclaimable:35796kB slab_unreclaimable:2068kB kernel_stack:256kB pagetables:788kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3362
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 45308 45308 45308
3363
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal free:42204kB min:42256kB low:88648kB high:135040kB active_anon:10349808kB inactive_anon:1319180kB active_file:27291764kB inactive_file:6535668kB unevictable:23392kB writepending:6546956kB present:47185920kB managed:46395912kB mlocked:23392kB slab_reclaimable:375908kB slab_unreclaimable:140740kB kernel_stack:10536kB pagetables:75420kB bounce:0kB free_pcp:16kB local_pcp:0kB free_cma:0kB
3364
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
3365
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal free:45076kB min:45104kB low:94624kB high:144144kB active_anon:9435588kB inactive_anon:1048292kB active_file:35340800kB inactive_file:2894612kB unevictable:141172kB writepending:2896680kB present:50331648kB managed:49526008kB mlocked:141172kB slab_reclaimable:277068kB slab_unreclaimable:75968kB kernel_stack:6120kB pagetables:41112kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
3366
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: lowmem_reserve[]: 0 0 0 0 0
3367
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA: 0*4kB 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15896kB
3368
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 DMA32: 3061*4kB (UME) 3323*8kB (UME) 1827*16kB (UME) 927*32kB (UME) 372*64kB (UME) 164*128kB (UME) 78*256kB (UME) 24*512kB (UME) 9*1024kB (UM) 0*2048kB 0*4096kB = 183996kB
3369
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 Normal: 1030*4kB (UME) 1986*8kB (UME) 1160*16kB (UME) 160*32kB (UME) 1*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 43752kB
3370
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 Normal: 1017*4kB (UME) 1131*8kB (UME) 783*16kB (UMEH) 380*32kB (UMEH) 122*64kB (UME) 8*128kB (MH) 2*256kB (MH) 2*512kB (MH) 0*1024kB 0*2048kB 0*4096kB = 48172kB
3371
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3372
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3373
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
3374
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
3375
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 18238165 total pagecache pages
3376
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 1671 pages in swap cache
3377
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Swap cache stats: add 1083334, delete 1081663, find 2679462/2985930
3378
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Free swap  = 8156400kB
3379
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: Total swap = 8388604kB
3380
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 25154187 pages RAM
3381
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages HighMem/MovableOnly
3382
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 415325 pages reserved
3383
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages cma reserved
3384
Mar 14 17:23:01 qa09.qa.fedoraproject.org kernel: 0 pages hwpoisoned
3385
Mar 14 17:22:07 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3386
Mar 14 17:22:17 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3387
Mar 14 17:22:27 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3388
Mar 14 17:22:37 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3389
Mar 14 17:22:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3390
Mar 14 17:22:57 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3391
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: [ERROR] 404 response: Not Found (remaining tries: 0)
3392
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: [ERROR] Job aborted because web UI doesn't accept updates anymore (likely considers this job dead)
3393
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[5943]: Mojo::Reactor::Poll: Timer failed: No worker id or webui host set! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 181.
3394
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[34675]: [ERROR] backend crashed ...
3395
Mar 14 17:23:01 qa09.qa.fedoraproject.org worker[34675]: killed 19708 - waiting for exit at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 47.
3396
Mar 14 17:23:02 qa09.qa.fedoraproject.org worker[5951]: [ERROR] backend crashed ...
3397
Mar 14 17:23:02 qa09.qa.fedoraproject.org worker[5951]: killed 19239 - waiting for exit at /usr/share/openqa/script/../lib/OpenQA/Worker/Engines/isotovideo.pm line 47.
3398
Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[5943]: WebUI Mojo::IOLoop=HASH(0x3558158) is unknown! - Should not happen but happened, exiting! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 404.
3399
Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[34675]: can't open /var/lib/openqa/pool/6/testresults/result-_do_install_and_reboot.json: No such file or directory at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 735.
3400
Mar 14 17:23:03 qa09.qa.fedoraproject.org worker[5943]: [INFO] registering worker with openQA Mojo::IOLoop=HASH(0x3558158)...
3401
Mar 14 17:23:04 qa09.qa.fedoraproject.org worker[5838]: [ERROR] 404 response: Not Found (remaining tries: 0)
3402
Mar 14 17:23:04 qa09.qa.fedoraproject.org worker[5838]: [ERROR] Job aborted because web UI doesn't accept updates anymore (likely considers this job dead)
3403
Mar 14 17:23:05 qa09.qa.fedoraproject.org worker[5838]: Mojo::Reactor::Poll: Timer failed: No worker id or webui host set! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 181.
3404
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[5951]: can't open /var/lib/openqa/pool/9/testresults/result-_do_install_and_reboot.json: No such file or directory at /usr/share/openqa/script/../lib/OpenQA/Worker/Jobs.pm line 735.
3405
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] killing os-autoinst 19708
3406
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] cleaning up 00079976-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_simple_free_space@uefi
3407
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] got job 79977: 00079977-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-upgrade_minimal_64bit@64bit
3408
Mar 14 17:23:06 qa09.qa.fedoraproject.org worker[34675]: [INFO] 20668: WORKING 79977
3409
Mar 14 17:23:07 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3410
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] killing os-autoinst 19239
3411
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] cleaning up 00079743-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_simple_encrypted@uefi
3412
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] got job 79978: 00079978-fedora-Rawhide-universal-x86_64-BuildFedora-Rawhide-20170314.n.0-install_multi_empty@uefi
3413
Mar 14 17:23:09 qa09.qa.fedoraproject.org worker[5951]: [INFO] 20674: WORKING 79978
3414
Mar 14 17:23:15 qa09.qa.fedoraproject.org worker[5838]: WebUI Mojo::IOLoop=HASH(0x325d0b0) is unknown! - Should not happen but happened, exiting! at /usr/share/openqa/script/../lib/OpenQA/Worker/Common.pm line 404.
3415
Mar 14 17:23:15 qa09.qa.fedoraproject.org worker[5838]: [INFO] registering worker with openQA Mojo::IOLoop=HASH(0x325d0b0)...
3416
Mar 14 17:23:16 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
3417
Mar 14 17:23:16 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
3418
Mar 14 17:23:17 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3419
Mar 14 17:23:22 qa09.qa.fedoraproject.org kernel: kvm [20683]: vcpu0, guest rIP: 0xffffffff8805e7e2 unhandled rdmsr: 0x34
3420
Mar 14 17:23:25 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
3421
Mar 14 17:23:25 qa09.qa.fedoraproject.org kernel: kvm: zapping shadow pages for mmio generation wraparound
3422
Mar 14 17:23:27 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3423
Mar 14 17:23:30 qa09.qa.fedoraproject.org kernel: kvm [20706]: vcpu1, guest rIP: 0xffffffffb3060bd2 unhandled rdmsr: 0x34
3424
Mar 14 17:23:37 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3425
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19431 (perl) with signal SIGKILL.
3426
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19433 (/usr/bin/isotov) with signal SIGKILL.
3427
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19434 (/usr/bin/isotov) with signal SIGKILL.
3428
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19435 (/usr/bin/isotov) with signal SIGKILL.
3429
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19438 (videoencoder) with signal SIGKILL.
3430
Mar 14 17:23:41 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@8.service: Killing process 19443 (qemu-system-x86) with signal SIGKILL.
3431
Mar 14 17:23:41 qa09.qa.fedoraproject.org audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=openqa-worker@8 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
3432
Mar 14 17:23:41 qa09.qa.fedoraproject.org audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:init_t:s0 msg='unit=openqa-worker@8 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
3433
Mar 14 17:23:47 qa09.qa.fedoraproject.org audit[1947]: AVC avc:  denied  { search } for  pid=1947 comm="in:imfile" name="audit" dev="dm-0" ino=50370687 scontext=system_u:system_r:syslogd_t:s0 tcontext=system_u:object_r:auditd_log_t:s0 tclass=dir permissive=0
3434
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17509 (perl) with signal SIGKILL.
3435
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17511 (/usr/bin/isotov) with signal SIGKILL.
3436
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17512 (/usr/bin/isotov) with signal SIGKILL.
3437
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17514 (/usr/bin/isotov) with signal SIGKILL.
3438
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17516 (videoencoder) with signal SIGKILL.
3439
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 17519 (qemu-system-x86) with signal SIGKILL.
3440
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38944 (gstack) with signal SIGKILL.
3441
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38948 (gdb) with signal SIGKILL.
3442
Mar 14 17:23:51 qa09.qa.fedoraproject.org systemd[1]: openqa-worker@2.service: Killing process 38949 (sed) with signal SIGKILL.