J
J
J_o_k_e_R2013-01-23 16:24:41
linux
J_o_k_e_R, 2013-01-23 16:24:41

Somewhere all the memory disappeared. Where and why?

When compiling firefox-17.0.2 with make -j13 (6-core processor with hyperthreading), for some reason the memory runs out (as far as I understood from the log below) and the compilation process is interrupted. The memory is 32 gigabytes, there are no obvious things for me that she clogged up with. The system has several partitions in tmpfs, but it is clearly not occupied by 32 gigabytes:
df -h | /dev/shm tmpfs 16G
664K 16G 1% /run tmpfs 5.0G 144K 5.0G 1% /tmp tmpfs 15G 2.8G 13G 1% /var/tmp tmpfs 1.0G 637M 388M 63% /usr/portage
Of course, I can reboot the car and everything will be fine (I hope), but this is somehow not sporty. Unfortunately, I do not have enough knowledge in memory allocation under Linux. Therefore, I will be grateful, firstly, for help with the obsolescence of my problem, secondly, for poking my nose into not very brain-crushing material, which allows me to deal with such problems myself in the future.
Kernel log Jan 23 16:57:44 cybernest kernel: [246619.816130] cc1plus invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0, oom_score_adj=0
23 16:57:44 cybernest kernel: [246619.816184] CPU 2 : hi: 186, btch: 31 usd: 30
Jan 23 16:57:44 cybernest kernel: [246619.816185] CPU 3: hi: 186, btch: 31 usd: 4
Jan 23 16:57:44 cybernest kernel: [246619.816186] CPU 4: hi: 186, btch: 31 usd: 18
Jan 23 16:57:44 cybernest kernel: [246619.816186] CPU 5: hi: 186, btch: 31 usd: 0
Jan 23 16:57:44 cybernest kernel: [246619.816187] CPU 6: hi: 186, btch: 31 usd : 0
Jan 23 16:57:44 cybernest kernel: [246619.816188] CPU 7: hi: 186, btch: 31 usd: 11
Jan 23 16:57:44 cybernest kernel: [246619.816189] CPU 8: hi: 186, btch: 31 usd: 0
Jan 23 16:57:44 cybernest kernel: [246619.816190] CPU 9: hi: 186, btch: 31 usd: 0
Jan 23 16:57:44 cybernest kernel: [246619.816191] CPU 10: hi: 186, btch: 31 usd: 0
Jan 23 16:57:44 cybernest kernel: [246619.816192] CPU 11: hi: 186, btch: 31 usd: 0
Jan 23 16:57:44 cybernest kernel: [246619.816192] Normal per-cpu:
Jan 23 16:57:44 cybernest kernel: [246619.816193] CPU 0: hi: 186, btch: 31 usd: 36
Jan 23 16:57:44 cybernest kernel: [246619.816194] CPU 1: hi: 186, btch: 31 usd: 6
Jan 23 16:57:44 cybernest kernel: [246619.816195] CPU 2: hi: 186, btch: 31 usd : 51
Jan 23 16:57:44 cybernest kernel: [246619.816196] CPU 3: hi: 186, btch: 31 usd: 59
Jan 23 16:57:44 cybernest kernel: [246619.816197] CPU 4: hi: 186, btch: 31 usd: 33
Jan 23 16:57:44 cybernest kernel: [246619.816197] CPU 5: hi: 186, btch: 31 usd: 1
Jan 23 16:57:44 cybernest kernel: [246619.816198] CPU 6: hi: 186, btch: 31 usd: 16
Jan 23 16:57:44 cybernest kernel: [246619.816199] CPU 7: hi: 186, btch: 31 usd: 35
Jan 23 16:57:44 cybernest kernel: [246619.816200] CPU 8: hi: 186, btch: 31 usd: 2
Jan 23 16:57:44 cybernest kernel: [246619.816201] CPU 9: hi: 186, btch: 31 usd: 3
Jan 23 16:57:44 cybernest kernel: [246619.816202] CPU 10: hi: 186, btch: 31 usd: 0
Jan 23 16:57:44 cybernest kernel: [246619.816203] CPU 11: hi: 186, btch: 31 usd : 10
Jan 23 16:57:44 cybernest kernel: [246619.816206] active_anon:1258979 inactive_anon:6168519 isolated_anon:0
Jan 23 16:57:44 cybernest kernel: [246619.816206] active_file:165 inactive_file:317 isolated_file
13: 57:44 cybernest kernel: [246619.816206] unevictable:0 dirty:0 writeback:0 unstable:0
Jan 23 16:57:44 cybernest kernel: [246619.816206] free:38815 slab_reclaimable:318980 slab_unreclaimable:400535
Jan 23 16:57:44 cybernest kernel: [246619.816206] mapped:6627 shmem:6717307 pagetables:13144 bounce:0
Jan 23 16:57:44 cybernest kernel: [246619.816211] DMA free:15888kB min:8kB low:8kB high:12kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file ):0kB present:15648kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Jan 23 16:57:44 cybernest kernel: [246619.816211] lowmem_reserve[]: 0 2934 32166 32166
Jan 23 16:57:44 cybernest kernel: [246619.816217] DMA32 free:118880kB min:2092kB low:2612kB high:3136kB active_anon:38972kB inactive_anon:2503304kB active_file:0kB inactive_file:0kB unevictable:0kBB isolated(anon): ):0kB present:3004748kB mlocked:0kB dirty:0kB writeback:0kB mapped:68kB shmem:2506888kB slab_reclaimable:153132kB slab_unreclaimable:184128kB kernel_stack:40kB pagetables:72kB unstable:0kB bounce:0kB allback_table? yes
Jan 23 16:57:44 cybernest kernel: [246619.816218] lowmem_reserve[]: 0 0 29232 29232
Jan 23 16:57:44 cybernest kernel: [246619.816223] Normal free:20492kB min:20852kB low:26064kB high:31276kB active_anon:4996944kB ): 128kB present: 29933568kB mlocked: 0kB dirty: 0kB writeback: 0kB mapped: 26440kB shmem: 24362340kB slab_reclaimable: 1122788kB slab_unreclaimable: 1417996kB kernel_stack: 5336kB pagetables: 52504kB unstable: 0kB bounce: 0kB writeback_tmp: 0kB pages_scanned: 3246 all_unreclaimable? yes
Jan 23 16:57:44 cybernest kernel: [246619.816224] lowmem_reserve[]: 0 0 0 0
Jan 23 16:57:44 cybernest kernel: [246619.816225] DMA: 0*4kB 0*8kB 1*16kB 0*32kB 2 *64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15888kB
Jan 23 16:57:44 cybernest kernel: [246619.816230] DMA32: 228*4kB 2553*8kB 1056*16kB 501*32kB 94*64kB 46*128kB 16*256kB 9*512kB 7*1024kB 2*8048kB = 191
Jan 23 04:57:44 p.m.
Jan 23 04:57:44 PM cybernest kernel: [246619.816238] 6718337 total pagecache pages
Jan 23 04:57:44 PM cybernest kernel: [246619.816239] 0 pages in swap
cache stats: add 0, delete 0, find 0/0
Jan 23 16:57:44 cybernest kernel: [246619.816241] Free swap = 0kB
Jan 23 16:57:44 cybernest kernel: [246619.816242] Total swap = 0kB
Jan 23 16:57:44 cybernest kernel: [246619.869457 ]
8388592
pages
16:57:44 cybernest kernel: [246619.869461] 8160731 pages non-shared
Jan 23 16:57:44 cybernest kernel: [246619.869462] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
Jan 23 16:57:44 cybernest kernel: [246619.869471] [ 759] 0 759 4358 192 14 0 -1000 udevd
Jan 23 16:57:44 cybernest kernel: [246619.869475] [ 2297] 0 2297 2140 38 9 0 0 dhcpcd
Jan 24: 16:57 246619.869477] [ 2473] 0 2473 2140 38 9 0 0 dhcpcd
Jan 23 16:57:44 cybernest kernel: [246619.869478] [ 2738] 0 2738 5683 51 15 0
0 -ng
Jan 23 16:57:44 cybernest kernel: [246619.869481] [ 2757] 0 2757 1058 35 8 0
0 -daemon
Jan 23 16:57:44 cybernest kernel: [246619.869484] [ 2812] 0 2812 1079392 297 91 0
0 53 0 0 polkitd
Jan 23 16:57:44 cybernest kernel: [246619.869487] [ 3038] 0 3038 4639 421 14 0 0 openvpn
Jan 23 16:57:44 cybernest kernel: [246619.869488] [ 3075] 0 7 3075 0 gpm
Jan 23 16:57:44 cybernest kernel: [246619.869490] [ 3179] 0 3179 6694 54 18 0
0
16:57:44 sshd
Jan
23 :57:44 cybernest kernel: [246619.869495] [ 3225] 0 3225 67498 1915 119
0
0 :44 cybernest kernel: [246619.869499] [ 3240] 1011 3240 186377 8422
185 0 0
Jan 23 16:57:44 cybernest kernel: [246619.869501] [ 3242] 81 3242 532753 8630 172 0
0
16:57:44 cybernest kernel: [246619.869504] [ 3397] 0 3397 4199 38 12 0 0 atd
Jan 23 16:57:44 cybernest kernel: [246619.869506] [ 3417] 0 3417 13866 244 32 0 2 cupsd
16: 57:44 cybernest kernel: [246619.869507] [ 3446] 105 3446 7921 1282 19
0
0 44 cybernest kernel: [246619.869510] [ 3483] 1000 3483 6083 75 17 0
0

Answer the question

In order to leave comments, you need to log in

1 answer(s)
A
agmt, 2013-01-23
@agmt

Here, however, the problem is in Windows and the linker, but suddenly it will help: habrahabr.ru/post/134525/ .

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question