nginx crash

MagicBear magicbearmo at gmail.com
Sat Nov 26 14:07:48 UTC 2011


Here is the crash bt.

GNU gdb (Ubuntu/Linaro 7.3-0ubuntu2) 7.3-2011.08
Copyright (C) 2011 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
For bug reporting instructions, please see:
<http://bugs.launchpad.net/gdb-linaro/>...
Reading symbols from /usr/sbin/nginx...done.
[New LWP 31365]

warning: Can't read pathname for load map: Input/output error.
[Thread debugging using libthread_db enabled]
Core was generated by `nginx:'.
Program terminated with signal 11, Segmentation fault.
#0  ngx_rbtree_min (sentinel=<optimized out>, node=0x0) at
src/core/ngx_rbtree.h:75
75	    while (node->left != sentinel) {
(gdb) bt
#0  ngx_rbtree_min (sentinel=<optimized out>, node=0x0) at
src/core/ngx_rbtree.h:75
#1  ngx_rbtree_delete (tree=0x7f463a38c000, node=0x7f463a38f000) at
src/core/ngx_rbtree.c:178
#2  0x0000000000451a24 in ngx_http_file_cache_free (c=0x2509a70,
tf=0x250a3a8) at src/http/ngx_http_file_cache.c:956
#3  0x0000000000447759 in ngx_http_upstream_process_request
(r=0x24ab650) at src/http/ngx_http_upstream.c:2738
#4  0x000000000044783b in ngx_http_upstream_process_upstream
(r=0x24ab650, u=0x24db4c0) at src/http/ngx_http_upstream.c:2677
#5  0x000000000044792c in ngx_http_upstream_handler (ev=<optimized
out>) at src/http/ngx_http_upstream.c:935
#6  0x0000000000425979 in ngx_event_expire_timers () at
src/event/ngx_event_timer.c:149
#7  0x00000000004255b0 in ngx_process_events_and_timers
(cycle=0x2465bf0) at src/event/ngx_event.c:261
#8  0x000000000042b2f7 in ngx_worker_process_cycle (cycle=0x2465bf0,
data=<optimized out>) at src/os/unix/ngx_process_cycle.c:801
#9  0x0000000000429cf2 in ngx_spawn_process (cycle=0x2465bf0,
proc=0x42b226 <ngx_worker_process_cycle>, data=0x0,
    name=0x47ecc9 "worker process", respawn=-4) at src/os/unix/ngx_process.c:196
#10 0x000000000042a9a6 in ngx_start_worker_processes (cycle=0x2465bf0,
n=4, type=-4) at src/os/unix/ngx_process_cycle.c:360
#11 0x000000000042bfc0 in ngx_master_process_cycle (cycle=0x2465bf0)
at src/os/unix/ngx_process_cycle.c:249
#12 0x00000000004119ff in main (argc=<optimized out>, argv=<optimized
out>) at src/core/nginx.c:405
(gdb) bt full
#0  ngx_rbtree_min (sentinel=<optimized out>, node=0x0) at
src/core/ngx_rbtree.h:75
No locals.
#1  ngx_rbtree_delete (tree=0x7f463a38c000, node=0x7f463a38f000) at
src/core/ngx_rbtree.c:178
        red = <optimized out>
        root = 0x7f463a38c000
        sentinel = 0x7f463a38c018
        subst = <optimized out>
        temp = <optimized out>
        w = <optimized out>
#2  0x0000000000451a24 in ngx_http_file_cache_free (c=0x2509a70,
tf=0x250a3a8) at src/http/ngx_http_file_cache.c:956
        cache = 0x27b2180
        fcn = 0x7f463a38f000
#3  0x0000000000447759 in ngx_http_upstream_process_request
(r=0x24ab650) at src/http/ngx_http_upstream.c:2738
        del = <optimized out>
        tf = <optimized out>
        p = 0x2509970
        u = 0x24db4c0
#4  0x000000000044783b in ngx_http_upstream_process_upstream
(r=0x24ab650, u=0x24db4c0) at src/http/ngx_http_upstream.c:2677
        c = <optimized out>
#5  0x000000000044792c in ngx_http_upstream_handler (ev=<optimized
out>) at src/http/ngx_http_upstream.c:935
        c = 0x7f4605082ed0
        r = <optimized out>
        ctx = <optimized out>
        u = <optimized out>
#6  0x0000000000425979 in ngx_event_expire_timers () at
src/event/ngx_event_timer.c:149
        ev = 0x7f4604ee3838
        root = 0x7f4604ed52d8
---Type <return> to continue, or q <return> to quit---
        sentinel = 0x6a9960
#7  0x00000000004255b0 in ngx_process_events_and_timers
(cycle=0x2465bf0) at src/event/ngx_event.c:261
        flags = 3
        timer = <optimized out>
        delta = 2
#8  0x000000000042b2f7 in ngx_worker_process_cycle (cycle=0x2465bf0,
data=<optimized out>) at src/os/unix/ngx_process_cycle.c:801
        i = <optimized out>
        c = <optimized out>
#9  0x0000000000429cf2 in ngx_spawn_process (cycle=0x2465bf0,
proc=0x42b226 <ngx_worker_process_cycle>, data=0x0,
    name=0x47ecc9 "worker process", respawn=-4) at src/os/unix/ngx_process.c:196
        on = 1
        pid = 0
        s = 3
#10 0x000000000042a9a6 in ngx_start_worker_processes (cycle=0x2465bf0,
n=4, type=-4) at src/os/unix/ngx_process_cycle.c:360
        i = <optimized out>
        ch = {command = 1, pid = 31364, slot = 2, fd = 15}
#11 0x000000000042bfc0 in ngx_master_process_cycle (cycle=0x2465bf0)
at src/os/unix/ngx_process_cycle.c:249
        title = <optimized out>
        p = <optimized out>
        size = <optimized out>
        i = <optimized out>
        n = <optimized out>
        sigio = 0
        set = {__val = {0 <repeats 16 times>}}
        itv = {it_interval = {tv_sec = 0, tv_usec = 0}, it_value =
{tv_sec = 0, tv_usec = 6}}
        live = 1
        delay = 0
---Type <return> to continue, or q <return> to quit---
        ls = <optimized out>
        ccf = 0x2466c90
#12 0x00000000004119ff in main (argc=<optimized out>, argv=<optimized
out>) at src/core/nginx.c:405
        i = <optimized out>
        log = 0x6a7720
        cycle = 0x2465bf0
        init_cycle = {conf_ctx = 0x0, pool = 0x24650d0, log =
0x6a7720, new_log = {log_level = 0, file = 0x0, connection = 0,
            handler = 0, data = 0x0, action = 0x0}, files = 0x0,
free_connections = 0x0, free_connection_n = 0,
          reusable_connections_queue = {prev = 0x0, next = 0x0},
listening = {elts = 0x0, nelts = 0, size = 0, nalloc = 0,
            pool = 0x0}, pathes = {elts = 0x0, nelts = 0, size = 0,
nalloc = 0, pool = 0x0}, open_files = {last = 0x0, part = {
              elts = 0x0, nelts = 0, next = 0x0}, size = 0, nalloc =
0, pool = 0x0}, shared_memory = {last = 0x0, part = {
              elts = 0x0, nelts = 0, next = 0x0}, size = 0, nalloc =
0, pool = 0x0}, connection_n = 0, files_n = 0,
          connections = 0x0, read_events = 0x0, write_events = 0x0,
old_cycle = 0x0, conf_file = {len = 21,
            data = 0x47b39f "/etc/nginx/nginx.conf"}, conf_param =
{len = 0, data = 0x0}, conf_prefix = {len = 11,
            data = 0x47b39f "/etc/nginx/nginx.conf"}, prefix = {len =
17, data = 0x47b38d "/usr/local/nginx/"}, lock_file = {
            len = 0, data = 0x0}, hostname = {len = 0, data = 0x0}}
        ccf = <optimized out>
(gdb)





I have increase the key size to 128M, the problem has disappear for 2
weeks, but just has happen again.


2011/11/24 António P. P. Almeida <appa at perusio.net>:
> On 23 Nov 2011 21h52 WET, mdounin at mdounin.ru wrote:
>
> Hello Maxim,
>
> I just created a new package with the two patches related to unlocking
> mutexes in shared memory zones you kindly provided.
>
> I'm wandering if this could also have something to do with a couple of
> 3rd party modules I'm using. Here's my nginx -V:
>
> nginx -V
> nginx version: nginx/1.1.8
> built by gcc 4.6.1 (Debian 4.6.1-15)
> TLS SNI support enabled
> configure arguments: --conf-path=/etc/nginx/nginx.conf
> --error-log-path=/var/log/nginx/error.log
> --http-client-body-temp-path=/var/lib/nginx/body
> --http-fastcgi-temp-path=/var/lib/nginx/fastcgi
> --http-log-path=/var/log/nginx/access.log
> --http-proxy-temp-path=/var/lib/nginx/proxy
> --lock-path=/var/lock/nginx.lock --pid-path=/var/run/nginx.pid
> --with-debug --without-mail_pop3_module --without-mail_imap_module
> --without-mail_smtp_module --without-http_scgi_module
> --without-http_uwsgi_module --with-http_flv_module
> --with-http_geoip_module --with-http_gzip_static_module
> --with-http_realip_module --with-http_stub_status_module
> --with-http_ssl_module --with-http_sub_module --with-ipv6
> --with-file-aio --with-http_secure_link_module --with-http_mp4_module
> --add-module=/home/appa/C/nginx/nginx-1.1.8/modules/nginx-upstream-fair
> --add-module=/home/appa/C/nginx/nginx-1.1.8/modules/nginx-upload-progress
> --add-module=/home/appa/C/nginx/nginx-1.1.8/modules/ngx_http_auth_request_module
> --add-module=/home/appa/C/nginx/nginx-1.1.8/modules/nginx-sticky-module
>
> Let's see if it solves the problem. If the problem resurfaces I'll
> provide a backtrace.
>
> Thanks,
> --- appa
>
> _______________________________________________
> nginx-devel mailing list
> nginx-devel at nginx.org
> http://mailman.nginx.org/mailman/listinfo/nginx-devel
>



-- 
MagicBear



More information about the nginx-devel mailing list