OOM в linux под нагрузкой

Ср Май 12 13:01:29 MSD 2010

Здравствуйте.
Вопрос не напрямую по nginx, но быть может вы можете посоветовать, куда
смотреть.
В пиках нагрузки (до 500 запросов в секунду) в системе возникает OOM,
oom_killer убивает сначала memcached (начинает использоваться резервный), а
потом воркеры nginx.
ядро 2.6.18-8.el5PAE #1 SMP i686
nginx/0.6.35
4 гигабайта оперативки (остаются в основном свободными во время развития
проблемы)
netstat -ant | wc -l под нагрузкой до 35000

в error.log только
2010/05/12 00:01:57 [alert] 13602#0: worker process 25850 exited on signal 9
2010/05/12 00:01:57 [crit] 25858#0: *69590141 SSL_do_handshake() failed
(SSL: error:140760FC:SSL routines:SSL23_GET_CLIENT_HELLO:unknown protocol)
while reading client request line, client: 10.11.2.195, server: nginx-1
2010/05/12 00:02:02 [alert] 13602#0: worker process 25858 exited on signal 9
2010/05/12 00:02:07 [alert] 13602#0: worker process 25867 exited on signal 9
2010/05/12 00:02:12 [alert] 13602#0: worker process 25886 exited on signal 9
...

/var/log/messages ниже

Спасибо заранее.

meminfo при маленькой нагрузке
# cat /proc/meminfo
MemTotal:      4152052 kB
MemFree:        149664 kB
Buffers:        103956 kB
Cached:        3257540 kB
SwapCached:      34836 kB
Active:        2304564 kB
Inactive:      1621656 kB
HighTotal:     3276480 kB
HighFree:         4516 kB
LowTotal:       875572 kB
LowFree:        145148 kB
SwapTotal:     2031608 kB
SwapFree:      1914948 kB
Dirty:            9596 kB
Writeback:           0 kB
AnonPages:      558040 kB
Mapped:          37780 kB
Slab:            62512 kB
PageTables:       2976 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   4107632 kB
Committed_AS:   796096 kB
VmallocTotal:   116728 kB
VmallocUsed:      3464 kB
VmallocChunk:   113172 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

/var/log/messages:
May 12 00:01:37 localhost kernel: printk: 96236 messages suppressed.
May 12 00:01:37 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:37 localhost kernel:  [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:01:37 localhost kernel:  [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:01:37 localhost kernel:  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:37 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:37 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:37 localhost kernel:  [<c0450ace>]  [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:37 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:37 localhost kernel:  [<c0451f01>]  [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:37 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:37 localhost kernel:  [<c0465e28>]  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:37 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:37 localhost kernel:  [<c0465bb1>]  [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:37 localhost kernel:  [<c059c045>] kmem_cache_alloc+0x41/0x4b
May 12 00:01:37 localhost kernel:  [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:01:37 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:37 localhost kernel:  [<c05dd45a>]  [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:38 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:38 localhost kernel:  [<c059a5d0>]  [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:38 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:38 localhost kernel:  [<c059a6c9>]  [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:38 localhost kernel: sock_create+0xb/0xe
May 12 00:01:38 localhost kernel:  [<c059a8a8>]  [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:38 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:38 localhost kernel:  [<c059b2a8>]  [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:38 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:38 localhost kernel:  [<c0403e95>]  [<c04063f2>]
sysenter_past_esp+0x56/0x79
May 12 00:01:38 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:38 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:38 localhost kernel:  =======================
May 12 00:01:39 localhost kernel: Mem-info:
May 12 00:01:39 localhost kernel: DMA per-cpu:
May 12 00:01:39 localhost kernel:  =======================
May 12 00:01:39 localhost kernel: Mem-info:
May 12 00:01:39 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:39 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:39 localhost kernel: DMA per-cpu:
May 12 00:01:39 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:40 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:41 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:41 localhost kernel: Normal per-cpu:
May 12 00:01:41 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:41 localhost kernel: Normal per-cpu:
May 12 00:01:41 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:41 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:41 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:41 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:41 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:42 localhost kernel: HighMem per-cpu:
May 12 00:01:42 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:42 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:42 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: HighMem per-cpu:
May 12 00:01:42 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:42 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: cpu 1 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:42 localhost kernel: cpu 1 hot: high 186, batch 31 used:18
May 12 00:01:42 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:42 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:42 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:42 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:42 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:42 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:42 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:42 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:1008 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:42 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:1008 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:42 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0DMA free:3548kB
min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB
pages_scanned:0 all_unreclaimable? yes
May 12 00:01:43 localhost kernel:  880 4592
May 12 00:01:43 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0lowmem_reserve[]: 0 0
880 4592
May 12 00:01:43 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:43 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:43 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:43 localhost kernel:  0 880DMA:  4592
May 12 00:01:43 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:43 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:43 localhost kernel: lowmem_reserve[]: 0 0 03*4kB 0*8kB 1*16kB
0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:43 localhost kernel: DMA32: empty
May 12 00:01:43 localhost kernel: Normal:  0
May 12 00:01:43 localhost kernel: DMA: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:43 localhost kernel: HighMem: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:43 localhost kernel: DMA32: empty
May 12 00:01:43 localhost kernel: Normal: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:43 localhost kernel: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:43 localhost kernel: HighMem: Swap cache: add 1091416, delete
1088465, find 517981/637567, race 0+1
May 12 00:01:43 localhost kernel: Free swap  = 1934920kB
May 12 00:01:43 localhost kernel: Total swap = 2031608kB
May 12 00:01:43 localhost kernel: Free swap:       1934920kB
May 12 00:01:43 localhost kernel: 952*4kB 95*8kB 95*16kB 23*32kB 0*64kB
4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:43 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:43 localhost kernel: Free swap  = 1934920kB
May 12 00:01:43 localhost kernel: Total swap = 2031608kB
May 12 00:01:44 localhost kernel: Free swap:       1934920kB
May 12 00:01:44 localhost kernel: 1179648 pages of RAM
May 12 00:01:44 localhost kernel: 1179648 pages of RAM
May 12 00:01:44 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:44 localhost kernel: 141635 reserved pages
May 12 00:01:44 localhost kernel: 745935 pages shared
May 12 00:01:44 localhost kernel: 2970 pages swap cached
May 12 00:01:44 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:44 localhost kernel: 141635 reserved pages
May 12 00:01:44 localhost kernel: 745935 pages shared
May 12 00:01:44 localhost kernel: 2970 pages swap cached
May 12 00:01:44 localhost kernel: 0 pages dirty
May 12 00:01:44 localhost kernel: 0 pages dirty
May 12 00:01:44 localhost kernel: 934 pages writeback
May 12 00:01:44 localhost kernel: 9241 pages mapped
May 12 00:01:44 localhost kernel: 188684 pages slab
May 12 00:01:45 localhost kernel: 766 pages pagetables
May 12 00:01:45 localhost kernel: 934 pages writeback
May 12 00:01:45 localhost kernel: 9241 pages mapped
May 12 00:01:45 localhost kernel: 188684 pages slab
May 12 00:01:45 localhost kernel: 766 pages pagetables
May 12 00:01:45 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:45 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:45 localhost kernel:  [<c0450ace>]  [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:45 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:45 localhost kernel:  [<c0451f01>]  [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:45 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:45 localhost kernel:  [<c0465e28>]  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:45 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:45 localhost kernel:  [<c0465bb1>]  [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:45 localhost kernel: kmem_cache_alloc+0x41/0x4b
May 12 00:01:45 localhost kernel:  [<c059c045>]  [<c059c045>]
sk_alloc+0x1e/0xe6
May 12 00:01:45 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:46 localhost kernel:  [<c05dd45a>]  [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:46 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:46 localhost kernel:  [<c059a5d0>]  [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:46 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:46 localhost kernel:  [<c059a6c9>]  [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:46 localhost kernel: sock_create+0xb/0xe
May 12 00:01:46 localhost kernel:  [<c059a8a8>]  [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:46 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:46 localhost kernel:  [<c059b2a8>]  [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:46 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:46 localhost kernel:  [<c0403e95>]  [<c04063f2>]
sysenter_past_esp+0x56/0x79
May 12 00:01:46 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:46 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:46 localhost kernel:  =======================
May 12 00:01:46 localhost kernel: Mem-info:
May 12 00:01:46 localhost kernel: DMA per-cpu:
May 12 00:01:46 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:46 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:46 localhost kernel:  =======================
May 12 00:01:46 localhost kernel: Mem-info:
May 12 00:01:47 localhost kernel: DMA per-cpu:
May 12 00:01:47 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:47 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:48 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:48 localhost kernel: Normal per-cpu:
May 12 00:01:49 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:49 localhost kernel: Normal per-cpu:
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:49 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:49 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:49 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:49 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:49 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:49 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:49 localhost kernel: HighMem per-cpu:
May 12 00:01:49 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:49 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:49 localhost kernel: HighMem per-cpu:
May 12 00:01:49 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:49 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:16
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:49 localhost kernel: cpu 1 hot: high 186, batch 31 used:16
May 12 00:01:49 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:49 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:49 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:50 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:50 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:50 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:50 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:50 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:50 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:50 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:50 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:50 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:50 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0Active:654227
inactive:160962 dirty:0 writeback:934 unstable:0 free:30701 slab:188684
mapped:9241 pagetables:766
May 12 00:01:50 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:50 localhost kernel:  0 29696
May 12 00:01:50 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:50 localhost kernel: DMA: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:50 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:50 localhost kernel: lowmem_reserve[]:3*4kB 0*8kB 1*16kB 0*32kB
1*64kB 1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:50 localhost kernel: DMA32: empty
May 12 00:01:50 localhost kernel: Normal:  0 0 0 29696
May 12 00:01:50 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:50 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:50 localhost kernel: DMA: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:50 localhost kernel: HighMem: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:50 localhost kernel: DMA32: empty
May 12 00:01:51 localhost kernel: Normal: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:51 localhost kernel: 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB
1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:51 localhost kernel: HighMem: Swap cache: add 1091416, delete
1088465, find 517981/637567, race 0+1
May 12 00:01:51 localhost kernel: Free swap  = 1934920kB
May 12 00:01:51 localhost kernel: Total swap = 2031608kB
May 12 00:01:51 localhost kernel: Free swap:       1934920kB
May 12 00:01:51 localhost kernel: 952*4kB 95*8kB 95*16kB 23*32kB 0*64kB
4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:51 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:51 localhost kernel: Free swap  = 1934920kB
May 12 00:01:51 localhost kernel: Total swap = 2031608kB
May 12 00:01:51 localhost kernel: Free swap:       1934920kB
May 12 00:01:51 localhost kernel: 1179648 pages of RAM
May 12 00:01:51 localhost kernel: 1179648 pages of RAM
May 12 00:01:51 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:51 localhost kernel: 141635 reserved pages
May 12 00:01:51 localhost kernel: 745937 pages shared
May 12 00:01:51 localhost kernel: 2970 pages swap cached
May 12 00:01:51 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:51 localhost kernel: 141635 reserved pages
May 12 00:01:51 localhost kernel: 745937 pages shared
May 12 00:01:51 localhost kernel: 2970 pages swap cached
May 12 00:01:51 localhost kernel: 0 pages dirty
May 12 00:01:51 localhost kernel: 934 pages writeback
May 12 00:01:51 localhost kernel: 9241 pages mapped
May 12 00:01:51 localhost kernel: 0 pages dirty
May 12 00:01:51 localhost kernel: 188684 pages slab
May 12 00:01:51 localhost kernel: 766 pages pagetables
May 12 00:01:51 localhost kernel: 934 pages writeback
May 12 00:01:51 localhost kernel: 9241 pages mapped
May 12 00:01:51 localhost kernel: 188684 pages slab
May 12 00:01:51 localhost kernel: 766 pages pagetables
May 12 00:01:51 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:51 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:51 localhost kernel:  [<c0450ace>]  [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:51 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:51 localhost kernel:  [<c0451f01>]  [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:51 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:52 localhost kernel:  [<c0465e28>]  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:52 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:52 localhost kernel:  [<c0465bb1>]  [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:52 localhost kernel: kmem_cache_alloc+0x41/0x4b
May 12 00:01:52 localhost kernel:  [<c059c045>]  [<c059c045>]
sk_alloc+0x1e/0xe6
May 12 00:01:52 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:52 localhost kernel:  [<c05dd45a>]  [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:52 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:52 localhost kernel:  [<c059a5d0>]  [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:52 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:52 localhost kernel:  [<c059a6c9>]  [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:52 localhost kernel: sock_create+0xb/0xe
May 12 00:01:52 localhost kernel:  [<c059a8a8>]  [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:52 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:52 localhost kernel:  [<c059b2a8>]  [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:52 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:52 localhost kernel:  [<c04063f2>]  [<c0403e95>]
sysenter_past_esp+0x56/0x79
May 12 00:01:52 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:52 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:52 localhost kernel:  =======================
May 12 00:01:52 localhost kernel: Mem-info:
May 12 00:01:52 localhost kernel: DMA per-cpu:
May 12 00:01:52 localhost kernel:  =======================
May 12 00:01:52 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:52 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:52 localhost kernel: Mem-info:
May 12 00:01:52 localhost kernel: DMA per-cpu:
May 12 00:01:52 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:52 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:53 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:53 localhost kernel: Normal per-cpu:
May 12 00:01:53 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:53 localhost kernel: Normal per-cpu:
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:53 localhost kernel: HighMem per-cpu:
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:53 localhost kernel: HighMem per-cpu:
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:53 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:14
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:53 localhost kernel: cpu 1 hot: high 186, batch 31 used:14
May 12 00:01:53 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:53 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:53 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:53 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:53 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:53 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:53 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:53 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:53 localhost kernel: Active:654227 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:53 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0DMA free:3548kB
min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB
pages_scanned:0 all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:54 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:54 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:54 localhost kernel:  880 4592
May 12 00:01:54 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:54 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:54 localhost kernel: lowmem_reserve[]:HighMem free:11176kB
min:512kB low:4476kB high:8440kB active:2616772kB inactive:639740kB
present:3801088kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:54 localhost kernel: DMA:  0 0 0 29696
May 12 00:01:54 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616772kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:54 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:54 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:54 localhost kernel: DMA32: empty
May 12 00:01:54 localhost kernel: Normal: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 26844*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 0*256kB 1*512kB
0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:01:54 localhost kernel: DMA32: empty
May 12 00:01:54 localhost kernel: Normal: 0*1024kB 0*2048kB 0*4096kB =
108080kB
May 12 00:01:55 localhost kernel: HighMem: 26844*4kB 0*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:55 localhost kernel: 0*2048kB 0*4096kB = 108080kB
May 12 00:01:55 localhost kernel: HighMem: Swap cache: add 1091416, delete
1088465, find 517981/637567, race 0+1
May 12 00:01:55 localhost kernel: Free swap  = 1934920kB
May 12 00:01:55 localhost kernel: 952*4kB 95*8kB 95*16kB 23*32kB 0*64kB
4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:55 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:55 localhost kernel: Free swap  = 1934920kB
May 12 00:01:55 localhost kernel: Total swap = 2031608kB
May 12 00:01:55 localhost kernel: Free swap:       1934920kB
May 12 00:01:55 localhost kernel: Total swap = 2031608kB
May 12 00:01:55 localhost kernel: Free swap:       1934920kB
May 12 00:01:55 localhost kernel: 1179648 pages of RAM
May 12 00:01:55 localhost kernel: 1179648 pages of RAM
May 12 00:01:55 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:55 localhost kernel: 950272 pages of HIGHMEM
May 12 00:01:55 localhost kernel: 141635 reserved pages
May 12 00:01:55 localhost kernel: 745934 pages shared
May 12 00:01:55 localhost kernel: 2970 pages swap cached
May 12 00:01:55 localhost kernel: 141635 reserved pages
May 12 00:01:55 localhost kernel: 745934 pages shared
May 12 00:01:55 localhost kernel: 2970 pages swap cached
May 12 00:01:55 localhost kernel: 0 pages dirty
May 12 00:01:55 localhost kernel: 934 pages writeback
May 12 00:01:55 localhost kernel: 9241 pages mapped
May 12 00:01:55 localhost kernel: 0 pages dirty
May 12 00:01:55 localhost kernel: 934 pages writeback
May 12 00:01:55 localhost kernel: 9241 pages mapped
May 12 00:01:55 localhost kernel: 188684 pages slab
May 12 00:01:55 localhost kernel: 766 pages pagetables
May 12 00:01:55 localhost kernel: 188684 pages slab
May 12 00:01:55 localhost kernel: 766 pages pagetables
May 12 00:01:55 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:55 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:01:55 localhost kernel:  [<c0450ace>]  [<c0450ace>]
out_of_memory+0x3b/0x179
May 12 00:01:55 localhost kernel: out_of_memory+0x3b/0x179
May 12 00:01:55 localhost kernel:  [<c0451f01>]  [<c0451f01>]
__alloc_pages+0x1fe/0x27e
May 12 00:01:56 localhost kernel: __alloc_pages+0x1fe/0x27e
May 12 00:01:56 localhost kernel:  [<c0465e28>]  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:01:56 localhost kernel: cache_alloc_refill+0x26d/0x44f
May 12 00:01:56 localhost kernel:  [<c0465bb1>]  [<c0465bb1>]
kmem_cache_alloc+0x41/0x4b
May 12 00:01:56 localhost kernel: kmem_cache_alloc+0x41/0x4b
May 12 00:01:56 localhost kernel:  [<c059c045>]  [<c059c045>]
sk_alloc+0x1e/0xe6
May 12 00:01:56 localhost kernel: sk_alloc+0x1e/0xe6
May 12 00:01:56 localhost kernel:  [<c05dd45a>]  [<c05dd45a>]
inet_create+0x10c/0x231
May 12 00:01:56 localhost kernel: inet_create+0x10c/0x231
May 12 00:01:56 localhost kernel:  [<c059a5d0>]  [<c059a5d0>]
__sock_create+0x133/0x213
May 12 00:01:56 localhost kernel: __sock_create+0x133/0x213
May 12 00:01:56 localhost kernel:  [<c059a6c9>]  [<c059a6c9>]
sock_create+0xb/0xe
May 12 00:01:56 localhost kernel: sock_create+0xb/0xe
May 12 00:01:56 localhost kernel:  [<c059a8a8>]  [<c059a8a8>]
sys_socket+0x18/0x38
May 12 00:01:56 localhost kernel: sys_socket+0x18/0x38
May 12 00:01:56 localhost kernel:  [<c059b2a8>]  [<c059b2a8>]
sys_socketcall+0x6c/0x19e
May 12 00:01:56 localhost kernel: sys_socketcall+0x6c/0x19e
May 12 00:01:56 localhost kernel:  [<c0403e95>]  [<c04063f2>]
sysenter_past_esp+0x56/0x79
May 12 00:01:56 localhost kernel: do_IRQ+0xa5/0xae
May 12 00:01:56 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:01:56 localhost kernel:  =======================
May 12 00:01:56 localhost kernel: Mem-info:
May 12 00:01:56 localhost kernel: DMA per-cpu:
May 12 00:01:56 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:56 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:56 localhost kernel:  =======================
May 12 00:01:57 localhost kernel: Mem-info:
May 12 00:01:57 localhost kernel: DMA per-cpu:cpu 1 hot: high 0, batch 1
used:0
May 12 00:01:57 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel:
May 12 00:01:57 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:57 localhost kernel: Normal per-cpu:
May 12 00:01:57 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:01:57 localhost kernel: DMA32 per-cpu: empty
May 12 00:01:57 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:57 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:57 localhost kernel: Normal per-cpu:
May 12 00:01:57 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:01:57 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:01:57 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:57 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:58 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:01:58 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:58 localhost kernel: HighMem per-cpu:
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:61
May 12 00:01:58 localhost kernel: HighMem per-cpu:
May 12 00:01:58 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:58 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:01:58 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 1 hot: high 186, batch 31 used:13
May 12 00:01:58 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:58 localhost kernel: cpu 1 hot: high 186, batch 31 used:13
May 12 00:01:58 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:01:58 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:58 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:01:58 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:01:58 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:58 localhost kernel: Free pages:      122804kB (11176kB
HighMem)
May 12 00:01:58 localhost kernel: Active:654241 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:58 localhost kernel: Active:654241 inactive:160962 dirty:0
writeback:934 unstable:0 free:30701 slab:188684 mapped:9241 pagetables:766
May 12 00:01:58 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:58 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:58 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0DMA free:3548kB
min:68kB low:84kB high:100kB active:0kB inactive:0kB present:16384kB
pages_scanned:0 all_unreclaimable? yes
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:01:58 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:01:58 localhost kernel: lowmem_reserve[]: 0 0 29696
May 12 00:01:59 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:59 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:59 localhost kernel: DMA:  0 880 4592
May 12 00:01:59 localhost kernel: Normal free:108080kB min:3756kB low:4692kB
high:5632kB active:136kB inactive:4108kB present:901120kB pages_scanned:8392
all_unreclaimable? yes
May 12 00:01:59 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:01:59 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:01:59 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:01:59 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB 3*4kB 0*8kB 1*16kB 0*32kB
1*64kB 1*128kB 1*256kB = 3548kB
May 12 00:01:59 localhost kernel: DMA32: empty
May 12 00:01:59 localhost kernel: Normal: 0*512kB 1*1024kB 1*2048kB 0*4096kB
= 3548kB
May 12 00:01:59 localhost kernel: DMA32: empty
May 12 00:01:59 localhost kernel: Normal: 26844*4kB 0*8kB 0*16kB 0*32kB
1*64kB 1*128kB 26844*4kB 0*8kB 0*16kB 0*32kB 0*256kB 1*512kB 0*1024kB
0*2048kB 0*4096kB = 108080kB
May 12 00:01:59 localhost kernel: HighMem: 1*64kB 1*128kB 0*256kB 1*512kB
0*1024kB 0*2048kB 0*4096kB = 108080kB
May 12 00:01:59 localhost kernel: HighMem: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:59 localhost kernel: 952*4kB 95*8kB Swap cache: add 1091416,
delete 1088465, find 517981/637567, race 0+1
May 12 00:01:59 localhost kernel: Free swap  = 1934920kB
May 12 00:01:59 localhost kernel: Total swap = 2031608kB
May 12 00:01:59 localhost kernel: Free swap:       1934920kB
May 12 00:01:59 localhost kernel: 95*16kB 23*32kB 0*64kB 4*128kB 3*256kB
6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:01:59 localhost kernel: Swap cache: add 1091416, delete 1088465,
find 517981/637567, race 0+1
May 12 00:01:59 localhost kernel: Free swap  = 1934920kB
May 12 00:01:59 localhost kernel: Total swap = 2031608kB
May 12 00:01:59 localhost kernel: Free swap:       1934920kB
May 12 00:01:59 localhost kernel: 1179648 pages of RAM
May 12 00:01:59 localhost kernel: 1179648 pages of RAM
May 12 00:02:00 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:00 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:00 localhost kernel: 141635 reserved pages
May 12 00:02:00 localhost kernel: 745927 pages shared
May 12 00:02:00 localhost kernel: 2970 pages swap cached
May 12 00:02:00 localhost kernel: 141635 reserved pages
May 12 00:02:00 localhost kernel: 745927 pages shared
May 12 00:02:00 localhost kernel: 2970 pages swap cached
May 12 00:02:00 localhost kernel: 0 pages dirty
May 12 00:02:00 localhost kernel: 934 pages writeback
May 12 00:02:00 localhost kernel: 0 pages dirty
May 12 00:02:00 localhost kernel: 934 pages writeback
May 12 00:02:00 localhost kernel: 9241 pages mapped
May 12 00:02:00 localhost kernel: 9241 pages mapped
May 12 00:02:00 localhost kernel: 188684 pages slab
May 12 00:02:00 localhost kernel: 766 pages pagetables
May 12 00:02:00 localhost kernel: 188684 pages slab
May 12 00:02:00 localhost kernel: 766 pages pagetables
May 12 00:02:00 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:02:00 localhost kernel:  [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:02:00 localhost kernel:  [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:02:00 localhost kernel:  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:02:00 localhost kernel:  [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:00 localhost kernel:  [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:00 localhost kernel:  [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:00 localhost kernel:  [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:00 localhost kernel:  [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:00 localhost kernel:  [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:00 localhost kernel:  [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:00 localhost kernel:  [<c04063f2>] do_IRQ+0xa5/0xae
May 12 00:02:00 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:00 localhost kernel:  =======================
May 12 00:02:00 localhost kernel: Mem-info:
May 12 00:02:00 localhost kernel: DMA per-cpu:
May 12 00:02:00 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:00 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:00 localhost kernel: Normal per-cpu:
May 12 00:02:00 localhost kernel: cpu 0 hot: high 186, batch 31 used:162
May 12 00:02:00 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:02:00 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:02:00 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:02:00 localhost kernel: cpu 2 hot: high 186, batch 31 used:95
May 12 00:02:00 localhost kernel: cpu 2 cold: high 62, batch 15 used:56
May 12 00:02:01 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:02:01 localhost kernel: cpu 3 cold: high 62, batch 15 used:62
May 12 00:02:01 localhost kernel: HighMem per-cpu:
May 12 00:02:01 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:02:01 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:02:01 localhost kernel: cpu 1 hot: high 186, batch 31 used:11
May 12 00:02:01 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:02:01 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:02:01 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:02:01 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:02:01 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:02:01 localhost kernel: Free pages:      122896kB (11176kB
HighMem)
May 12 00:02:01 localhost kernel: Active:654209 inactive:160962 dirty:0
writeback:934 unstable:0 free:30730 slab:188684 mapped:9241 pagetables:766
May 12 00:02:01 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:01 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:01 localhost kernel: Normal free:108260kB min:3756kB low:4692kB
high:5632kB active:8kB inactive:4108kB present:901120kB pages_scanned:0
all_unreclaimable? no
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:02:01 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:02:01 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:02:01 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:02:01 localhost kernel: DMA32: empty
May 12 00:02:01 localhost kernel: Normal: 26876*4kB 14*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 108320kB
May 12 00:02:01 localhost kernel: HighMem: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:02:01 localhost kernel: Swap cache: add 1091416, delete 1088529,
find 517981/637567, race 0+1
May 12 00:02:01 localhost kernel: Free swap  = 1934920kB
May 12 00:02:02 localhost kernel: Total swap = 2031608kB
May 12 00:02:02 localhost kernel: Free swap:       1934920kB
May 12 00:02:02 localhost kernel: 1179648 pages of RAM
May 12 00:02:02 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:02 localhost kernel: 141635 reserved pages
May 12 00:02:02 localhost kernel: 745928 pages shared
May 12 00:02:02 localhost kernel: 2887 pages swap cached
May 12 00:02:02 localhost kernel: 0 pages dirty
May 12 00:02:02 localhost kernel: 749 pages writeback
May 12 00:02:02 localhost kernel: 9241 pages mapped
May 12 00:02:02 localhost kernel: 188760 pages slab
May 12 00:02:02 localhost kernel: 766 pages pagetables
May 12 00:02:02 localhost kernel:  [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:02 localhost kernel:  [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:02 localhost kernel:  [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:02 localhost kernel:  [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:02 localhost kernel:  [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:03 localhost kernel:  [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:03 localhost kernel:  [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:03 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:03 localhost kernel:  =======================
May 12 00:02:03 localhost kernel: Mem-info:
May 12 00:02:03 localhost kernel: DMA per-cpu:
May 12 00:02:03 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:03 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:03 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:04 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:04 localhost kernel: Normal per-cpu:
May 12 00:02:04 localhost kernel: cpu 0 hot: high 186, batch 31 used:176
May 12 00:02:04 localhost kernel: cpu 0 cold: high 62, batch 15 used:60
May 12 00:02:04 localhost kernel: cpu 1 hot: high 186, batch 31 used:35
May 12 00:02:04 localhost kernel: cpu 1 cold: high 62, batch 15 used:51
May 12 00:02:04 localhost kernel: cpu 2 hot: high 186, batch 31 used:104
May 12 00:02:04 localhost kernel: cpu 2 cold: high 62, batch 15 used:48
May 12 00:02:04 localhost kernel: cpu 3 hot: high 186, batch 31 used:18
May 12 00:02:04 localhost kernel: cpu 3 cold: high 62, batch 15 used:47
May 12 00:02:04 localhost kernel: HighMem per-cpu:
May 12 00:02:04 localhost kernel: cpu 0 hot: high 186, batch 31 used:159
May 12 00:02:05 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:02:05 localhost kernel: cpu 1 hot: high 186, batch 31 used:8
May 12 00:02:05 localhost kernel: cpu 1 cold: high 62, batch 15 used:58
May 12 00:02:05 localhost kernel: cpu 2 hot: high 186, batch 31 used:185
May 12 00:02:05 localhost kernel: cpu 2 cold: high 62, batch 15 used:49
May 12 00:02:05 localhost kernel: cpu 3 hot: high 186, batch 31 used:163
May 12 00:02:05 localhost kernel: cpu 3 cold: high 62, batch 15 used:42
May 12 00:02:05 localhost kernel: Free pages:      124284kB (11176kB
HighMem)
May 12 00:02:05 localhost kernel: Active:654240 inactive:160446 dirty:0
writeback:527 unstable:0 free:31071 slab:188837 mapped:9241 pagetables:766
May 12 00:02:05 localhost kernel: DMA free:3548kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:05 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:05 localhost kernel: Normal free:109484kB min:3756kB low:4692kB
high:5632kB active:132kB inactive:2044kB present:901120kB pages_scanned:0
all_unreclaimable? no
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:02:05 localhost kernel: HighMem free:11176kB min:512kB low:4476kB
high:8440kB active:2616828kB inactive:639740kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:02:05 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:02:05 localhost kernel: DMA: 3*4kB 0*8kB 1*16kB 0*32kB 1*64kB
1*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3548kB
May 12 00:02:07 localhost kernel: DMA32: empty
May 12 00:02:07 localhost kernel: Normal: 27075*4kB 60*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 109484kB
May 12 00:02:07 localhost kernel: HighMem: 952*4kB 95*8kB 95*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 11176kB
May 12 00:02:07 localhost kernel: Swap cache: add 1091416, delete 1088979,
find 517981/637567, race 0+1
May 12 00:02:07 localhost kernel: Free swap  = 1934920kB
May 12 00:02:07 localhost kernel: Total swap = 2031608kB
May 12 00:02:07 localhost kernel: Free swap:       1934920kB
May 12 00:02:07 localhost kernel: 1179648 pages of RAM
May 12 00:02:07 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:07 localhost kernel: 141635 reserved pages
May 12 00:02:07 localhost kernel: 745928 pages shared
May 12 00:02:07 localhost kernel: 2456 pages swap cached
May 12 00:02:07 localhost kernel: 0 pages dirty
May 12 00:02:07 localhost kernel: 194 pages writeback
May 12 00:02:07 localhost kernel: 9241 pages mapped
May 12 00:02:07 localhost kernel: 189115 pages slab
May 12 00:02:07 localhost kernel: 766 pages pagetables
May 12 00:02:07 localhost kernel: Out of memory: Killed process 13606
(nginx).
May 12 00:02:07 localhost kernel: printk: 135598 messages suppressed.
May 12 00:02:07 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:02:08 localhost kernel:  [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:02:08 localhost kernel:  [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:02:08 localhost kernel:  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:02:08 localhost kernel:  [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:08 localhost kernel:  [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:08 localhost kernel:  [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:08 localhost kernel:  [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:08 localhost kernel:  [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:08 localhost kernel:  [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:08 localhost kernel:  [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:08 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:08 localhost kernel:  =======================
May 12 00:02:08 localhost kernel: Mem-info:
May 12 00:02:08 localhost kernel: DMA per-cpu:
May 12 00:02:08 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:08 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:08 localhost kernel: Normal per-cpu:
May 12 00:02:08 localhost kernel: cpu 0 hot: high 186, batch 31 used:1
May 12 00:02:08 localhost kernel: cpu 0 cold: high 62, batch 15 used:49
May 12 00:02:08 localhost kernel: cpu 1 hot: high 186, batch 31 used:4
May 12 00:02:08 localhost kernel: cpu 1 cold: high 62, batch 15 used:61
May 12 00:02:08 localhost kernel: cpu 2 hot: high 186, batch 31 used:24
May 12 00:02:08 localhost kernel: cpu 2 cold: high 62, batch 15 used:48
May 12 00:02:08 localhost kernel: cpu 3 hot: high 186, batch 31 used:21
May 12 00:02:08 localhost kernel: cpu 3 cold: high 62, batch 15 used:48
May 12 00:02:08 localhost kernel: HighMem per-cpu:
May 12 00:02:09 localhost kernel: cpu 0 hot: high 186, batch 31 used:0
May 12 00:02:09 localhost kernel: cpu 0 cold: high 62, batch 15 used:22
May 12 00:02:09 localhost kernel: cpu 1 hot: high 186, batch 31 used:0
May 12 00:02:09 localhost kernel: cpu 1 cold: high 62, batch 15 used:48
May 12 00:02:09 localhost kernel: cpu 2 hot: high 186, batch 31 used:29
May 12 00:02:09 localhost kernel: cpu 2 cold: high 62, batch 15 used:28
May 12 00:02:09 localhost kernel: cpu 3 hot: high 186, batch 31 used:16
May 12 00:02:09 localhost kernel: cpu 3 cold: high 62, batch 15 used:34
May 12 00:02:09 localhost kernel: Free pages:      176232kB (34612kB
HighMem)
May 12 00:02:09 localhost kernel: Active:649045 inactive:159818 dirty:55
writeback:33 unstable:0 free:44058 slab:182485 mapped:9330 pagetables:759
May 12 00:02:09 localhost kernel: DMA free:3552kB min:68kB low:84kB
high:100kB active:0kB inactive:0kB present:16384kB pages_scanned:0
all_unreclaimable? yes
May 12 00:02:09 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:10 localhost kernel: DMA32 free:0kB min:0kB low:0kB high:0kB
active:0kB inactive:0kB present:0kB pages_scanned:0 all_unreclaimable? no
May 12 00:02:10 localhost kernel: lowmem_reserve[]: 0 0 880 4592
May 12 00:02:10 localhost kernel: Normal free:138068kB min:3756kB low:4692kB
high:5632kB active:84kB inactive:68kB present:901120kB pages_scanned:3104
all_unreclaimable? yes
May 12 00:02:10 localhost kernel: lowmem_reserve[]: 0 0 0 29696
May 12 00:02:10 localhost kernel: HighMem free:34612kB min:512kB low:4476kB
high:8440kB active:2596180kB inactive:639120kB present:3801088kB
pages_scanned:0 all_unreclaimable? no
May 12 00:02:10 localhost kernel: lowmem_reserve[]: 0 0 0 0
May 12 00:02:10 localhost kernel: DMA: 78*4kB 1*8kB 0*16kB 1*32kB 0*64kB
1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 0*4096kB = 3552kB
May 12 00:02:10 localhost kernel: DMA32: empty
May 12 00:02:10 localhost kernel: Normal: 34341*4kB 0*8kB 0*16kB 0*32kB
1*64kB 1*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 138068kB
May 12 00:02:10 localhost kernel: HighMem: 515*4kB 2755*8kB 339*16kB 23*32kB
0*64kB 4*128kB 3*256kB 6*512kB 0*1024kB 0*2048kB 0*4096kB = 34612kB
May 12 00:02:10 localhost kernel: Swap cache: add 1093192, delete 1089598,
find 518314/638147, race 0+1
May 12 00:02:10 localhost kernel: Free swap  = 1937820kB
May 12 00:02:10 localhost kernel: Total swap = 2031608kB
May 12 00:02:10 localhost kernel: Free swap:       1937820kB
May 12 00:02:10 localhost kernel: 1179648 pages of RAM
May 12 00:02:10 localhost kernel: 950272 pages of HIGHMEM
May 12 00:02:10 localhost kernel: 141635 reserved pages
May 12 00:02:11 localhost kernel: 738674 pages shared
May 12 00:02:11 localhost kernel: 3613 pages swap cached
May 12 00:02:11 localhost kernel: 55 pages dirty
May 12 00:02:11 localhost kernel: 33 pages writeback
May 12 00:02:11 localhost kernel: 9330 pages mapped
May 12 00:02:11 localhost kernel: 182485 pages slab
May 12 00:02:11 localhost kernel: 759 pages pagetables
May 12 00:02:11 localhost kernel: possible SYN flooding on port 443. Sending
cookies.
May 12 00:02:11 localhost kernel: Out of memory: Killed process 25816
(nginx).
May 12 00:02:11 localhost kernel: printk: 198999 messages suppressed.
May 12 00:02:11 localhost kernel: nginx invoked oom-killer: gfp_mask=0xd0,
order=1, oomkilladj=0
May 12 00:02:11 localhost kernel:  [<c0450ace>] out_of_memory+0x3b/0x179
May 12 00:02:11 localhost kernel:  [<c0451f01>] __alloc_pages+0x1fe/0x27e
May 12 00:02:11 localhost kernel:  [<c0465e28>]
cache_alloc_refill+0x26d/0x44f
May 12 00:02:11 localhost kernel:  [<c0465bb1>] kmem_cache_alloc+0x41/0x4b
May 12 00:02:11 localhost kernel:  [<c059c045>] sk_alloc+0x1e/0xe6
May 12 00:02:11 localhost kernel:  [<c05dd45a>] inet_create+0x10c/0x231
May 12 00:02:11 localhost kernel:  [<c059a5d0>] __sock_create+0x133/0x213
May 12 00:02:11 localhost kernel:  [<c059a6c9>] sock_create+0xb/0xe
May 12 00:02:11 localhost kernel:  [<c059a8a8>] sys_socket+0x18/0x38
May 12 00:02:11 localhost kernel:  [<c059b2a8>] sys_socketcall+0x6c/0x19e
May 12 00:02:11 localhost kernel:  [<c0403e95>] sysenter_past_esp+0x56/0x79
May 12 00:02:11 localhost kernel:  =======================
May 12 00:02:11 localhost kernel: Mem-info:
May 12 00:02:11 localhost kernel: DMA per-cpu:
May 12 00:02:11 localhost kernel: cpu 0 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 0 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 1 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 1 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 2 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 2 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 3 hot: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: cpu 3 cold: high 0, batch 1 used:0
May 12 00:02:11 localhost kernel: DMA32 per-cpu: empty
May 12 00:02:12 localhost kernel: Normal per-cpu:
May 12 00:02:12 localhost kernel: cpu 0 hot: high 186, batch 31 used:31
May 12 00:02:12 localhost kernel: cpu 0 cold: high 62, batch 15 used:58
May 12 00:02:12 localhost kernel: cpu 1 hot: high 186, batch 31 used:105
May 12 00:02:13 localhost kernel: cpu 1 cold: high 62, batch 15 used:47
May 12 00:02:13 localhost kernel: cpu 2 hot: high 186, batch 31 used:6
May 12 00:02:13 localhost kernel: cpu 2 cold: high 62, batch 15 used:47
May 12 00:02:14 localhost kernel: cpu 3 hot: high 186, batch 31 used:24
May 12 00:02:14 localhost kernel: cpu 3 cold: high 62, batch 15 used:52
May 12 00:02:15 localhost kernel: HighMem per-cpu:
May 12 00:02:15 localhost kernel: cpu 0 hot: high 186, batch 31 used:12
May 12 00:02:16 localhost kernel: cpu 0 cold: high 62, batch 15 used:22
May 12 00:02:16 localhost kernel: cpu 1 hot: high 186, batch 31 used:177
May 12 00:02:17 localhost kernel: cpu 1 cold: high 62, batch 15 used:16
May 12 00:02:17 localhost kernel: cpu 2 hot: high 186, batch 31 used:14
May 12 00:02:18 localhost kernel: cpu 2 cold: high 62, batch 15 used:11
May 12 00:02:18 localhost kernel: cpu 3 hot: high 186, batch 31 used:2
May 12 00:02:18 localhost kernel: cpu 3 cold: high 62, batch 15 used:34
May 12 00:02:18 localhost kernel: Free pages:      190492kB (55012kB
HighMem)
May 12 00:02:19 localhost kernel: Active:643824 inactive:159875 dirty:12
writeback:5 unstable:0 free:47623 slab:183951 mapped:9332 pagetables:730

-- 
С уважением,
Алексей Лоскутов
----------- следущая часть -----------
Вложение в формате HTML было извлечено&hellip;
URL: <http://nginx.org/pipermail/nginx-ru/attachments/20100512/880907f6/attachment-0001.html>