Project

General

Profile

Actions

tickets #167368

open

oom-kill on mx1

Added by crameleon 3 months ago. Updated 3 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
Servers hosted in PRG
Target version:
-
Start date:
2024-09-25
Due date:
% Done:

0%

Estimated time:

Description

[122676.049491] smtp invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0
[122676.049503] CPU: 0 PID: 662 Comm: smtp Not tainted 6.4.0-150600.23.22-default #1 SLE15-SP6 f982acbc696ba69ee50caa39978059db447315f4
[122676.049509] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.16.2-3-gd478f380-rebuilt.opensuse.org 04/01/2014
[122676.049512] Call Trace:
[122676.049537]  <TASK>
[122676.049543]  dump_stack_lvl+0x57/0x80
[122676.049555]  dump_header+0x4a/0x230
[122676.049563]  oom_kill_process+0x138/0x190
[122676.049568]  out_of_memory+0x10b/0x570
[122676.049573]  __alloc_pages_slowpath.constprop.76+0xa81/0xda0
[122676.049585]  __alloc_pages+0x306/0x350
[122676.049590]  folio_alloc+0x17/0x40
[122676.049595]  ? filemap_get_entry+0xde/0x150
[122676.049603]  filemap_alloc_folio+0xb2/0x100
[122676.049609]  __filemap_get_folio+0xbe/0x400
[122676.049613]  ? srso_return_thunk+0x5/0x5f
[122676.049620]  ? page_cache_ra_unbounded+0x13b/0x180
[122676.049626]  filemap_fault+0x479/0xfd0
[122676.049630]  ? srso_return_thunk+0x5/0x5f
[122676.049633]  ? srso_return_thunk+0x5/0x5f
[122676.049636]  ? next_uptodate_page+0xe2/0x1f0
[122676.049640]  ? srso_return_thunk+0x5/0x5f
[122676.049642]  ? filemap_map_pages+0x14b/0x620
[122676.049648]  __do_fault+0x30/0x140
[122676.049654]  do_pte_missing+0x2c3/0x7f0
[122676.049659]  __handle_mm_fault+0x5d9/0xba0
[122676.049663]  ? srso_return_thunk+0x5/0x5f
[122676.049669]  handle_mm_fault+0x119/0x2f0
[122676.049674]  do_user_addr_fault+0x245/0x890
[122676.049686]  exc_page_fault+0x69/0x150
[122676.049694]  asm_exc_page_fault+0x22/0x30
[122676.049705] RIP: 0033:0x7f25ac17e5ee
[122676.049733] Code: Unable to access opcode bytes at 0x7f25ac17e5c4.
[122676.049736] RSP: 002b:00007ffe6c520df8 EFLAGS: 00010216
[122676.049739] RAX: 0000000000000000 RBX: 000000000000003a RCX: 0000000000000000
[122676.049742] RDX: 000000000000003a RSI: 0000564b48edbd97 RDI: 0000564b48eb33e0
[122676.049744] RBP: 0000564b48e6b560 R08: 0000000000000000 R09: 0000000000000007
[122676.049746] R10: 00007ffe6c520d70 R11: 0000000000000202 R12: 000000000000003a
[122676.049748] R13: 0000564b48eb33e0 R14: 000000000000003a R15: 0000000000000007
[122676.049755]  </TASK>
[122676.049772] Mem-Info:
[122676.049775] active_anon:721237 inactive_anon:161341 isolated_anon:0
                 active_file:46 inactive_file:1 isolated_file:0
                 unevictable:20 dirty:0 writeback:0
                 slab_reclaimable:7636 slab_unreclaimable:14271
                 mapped:27 shmem:47 pagetables:5767
                 sec_pagetables:0 bounce:0
                 kernel_misc_reclaimable:0
                 free:24807 free_pcp:0 free_cma:0
[122676.049783] Node 0 active_anon:2884948kB inactive_anon:645364kB active_file:184kB inactive_file:4kB unevictable:80kB isolated(anon):0kB isolated(file):0kB mapped:108kB dirty:0kB writeback:0kB shmem:188kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 931840kB writeback_tmp:0kB kernel_stack:5264kB pagetables:23068kB sec_pagetables:0kB all_unreclaimable? yes
[122676.049790] Node 0 DMA free:14336kB boost:0kB min:180kB low:224kB high:268kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[122676.049797] lowmem_reserve[]: 0 1953 5610 5610 5610
[122676.049803] Node 0 DMA32 free:38044kB boost:0kB min:23464kB low:29328kB high:35192kB reserved_highatomic:0KB active_anon:1656104kB inactive_anon:284092kB active_file:452kB inactive_file:232kB unevictable:0kB writepending:0kB present:2080624kB managed:2015088kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[122676.049810] lowmem_reserve[]: 0 0 3657 3657 3657
[122676.049817] Node 0 Normal free:46848kB boost:0kB min:43936kB low:54920kB high:65904kB reserved_highatomic:4096KB active_anon:1228844kB inactive_anon:361272kB active_file:0kB inactive_file:100kB unevictable:80kB writepending:0kB present:3903488kB managed:1752060kB mlocked:80kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[122676.049822] lowmem_reserve[]: 0 0 0 0 0
[122676.049829] Node 0 DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB (M) 3*4096kB (M) = 14336kB
[122676.049846] Node 0 DMA32: 905*4kB (UME) 440*8kB (UME) 295*16kB (UME) 294*32kB (UME) 106*64kB (UME) 34*128kB (UME) 13*256kB (UME) 4*512kB (UME) 2*1024kB (UM) 0*2048kB 0*4096kB = 39828kB
[122676.049869] Node 0 Normal: 586*4kB (UME) 241*8kB (UME) 387*16kB (UME) 239*32kB (UME) 93*64kB (UME) 46*128kB (UME) 24*256kB (ME) 13*512kB (UME) 4*1024kB (UM) 0*2048kB 0*4096kB = 46848kB
[122676.049893] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[122676.049896] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[122676.049899] 1281 total pagecache pages
[122676.049901] 1113 pages in swap cache
[122676.049902] Free swap  = 0kB
[122676.049904] Total swap = 262140kB
[122676.049905] 1500026 pages RAM
[122676.049907] 0 pages HighMem/MovableOnly
[122676.049908] 554399 pages reserved
[122676.049910] 0 pages cma reserved
[122676.049912] 0 pages hwpoisoned
[122676.049913] Tasks state (memory values in pages):
< ... snip ... >
[122676.050548] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=clamd,pid=2061,uid=65
[122676.050571] Out of memory: Killed process 2061 (clamd) total-vm:3122884kB, anon-rss:2721708kB, file-rss:0kB, shmem-rss:0kB, UID:65 pgtables:5676kB oom_score_adj:0

Files

dmesg.mx1 (75.4 KB) dmesg.mx1 crameleon, 2024-09-25 11:29
Actions #1

Updated by crameleon 3 months ago

Actions #2

Updated by crameleon 3 months ago

  • Subject changed from Postfix runs out of memory on mx1 to oom-kill on mx1

Figure out why / this is the first time this happened and Postfix is rather lightweight generally.

Actions #3

Updated by cboltz 3 months ago

Yeah, postfix. But have a look at the last line you quoted:

Out of memory: Killed process 2061 (clamd)

Maybe it tried to scan a 42.zip? ;-)

Actions #4

Updated by crameleon 3 months ago

Would the invocation come from the smtp process, then?

Actions #5

Updated by cboltz 3 months ago

clamd is started as a separate daemon (clamd.service), and postfix feeds it with incoming mails. I'm not sure if that qualifies as "invocation" ;-)

Actions #6

Updated by crameleon 3 months ago

Right, I was asking because smtp invoked oom-killer.

Actions

Also available in: Atom PDF