падение мастер процесса
Ivan Palanevich
loverjoni на gmail.com
Чт Май 10 17:36:06 UTC 2012
Заметил, что падает мастер процесс при отправке -HUP,
cat /etc/redhat-release
CentOS release 5.8 (Final)
Linux server 2.6.18-308.4.1.el5 #1 SMP Tue Apr 17 17:08:00 EDT 2012 x86_64 x86_64 x86_64 GNU/Linux
nginx -V
nginx version: nginx/1.2.0
built by gcc 4.1.2 20080704 (Red Hat 4.1.2-52)
TLS SNI support enabled
configure arguments: --user=nginx --group=nginx --prefix=/usr/share/nginx --sbin-path=/usr/sbin/nginx --conf-path=/etc/nginx/nginx.conf --error-log-path=/var/log/nginx/error.log --http-log-path=/var/log/nginx/access.log --http-client-body-temp-path=/var/lib/nginx/tmp/client_body --http-proxy-temp-path=/var/lib/nginx/tmp/proxy --http-fastcgi-temp-path=/var/lib/nginx/tmp/fastcgi --pid-path=/var/run/nginx.pid --lock-path=/var/lock/subsys/nginx --with-openssl=/home/mockbuild/rpmbuild/BUILD/nginx-1.2.0/openssl-0.9.8t/ --with-openssl-opt=enable-tlsext --with-http_secure_link_module --with-http_random_index_module --with-http_ssl_module --with-http_realip_module --with-http_addition_module --with-http_sub_module --with-http_dav_module --with-http_gzip_static_module --with-http_stub_status_module --with-http_perl_module --with-http_geoip_module --with-debug --with-ipv6 --with-file-aio --with-cc-opt='-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic' --add-module=/home/mockbuild/rpmbuild/BUILD/nginx-1.2.0/nginx-upstream-fair --add-module=/home/mockbuild/rpmbuild/BUILD/nginx-1.2.0/mod_ustats
Из последних добавленных модификаций
--with-openssl=/home/mockbuild/rpmbuild/BUILD/nginx-1.2.0/openssl-0.9.8t/
Началось до 1.2.0 , но с какой точно версии не помню.
cat /var/log/nginx/error.log
2012/05/10 20:35:03 [debug] 1857#0: bind() 0.0.0.0:80 #6
2012/05/10 20:35:03 [debug] 1857#0: counter: 00002B03896A3080, 1
2012/05/10 20:35:04 [debug] 1866#0: bind() 0.0.0.0:80 #6
2012/05/10 20:35:04 [notice] 1866#0: using the "epoll" event method
2012/05/10 20:35:04 [debug] 1866#0: counter: 00002B0E900BD080, 1
2012/05/10 20:35:04 [notice] 1866#0: nginx/1.2.0
2012/05/10 20:35:04 [notice] 1866#0: built by gcc 4.1.2 20080704 (Red Hat 4.1.2-52)
2012/05/10 20:35:04 [notice] 1866#0: OS: Linux 2.6.18-308.4.1.el5
2012/05/10 20:35:04 [notice] 1866#0: getrlimit(RLIMIT_NOFILE): 1024:1024
2012/05/10 20:35:04 [debug] 1867#0: write: 7, 00007FFF76633380, 5, 0
2012/05/10 20:35:04 [debug] 1867#0: setproctitle: "nginx: master process /usr/sbin/nginx -c /etc/nginx/nginx.conf"
2012/05/10 20:35:04 [notice] 1867#0: start worker processes
2012/05/10 20:35:04 [debug] 1867#0: channel 3:7
2012/05/10 20:35:04 [debug] 1868#0: eventfd: 9
2012/05/10 20:35:04 [debug] 1868#0: malloc: 0000000003D5C9D0:6144
2012/05/10 20:35:04 [debug] 1868#0: malloc: 00002B0E900BE010:9600000
2012/05/10 20:35:04 [debug] 1868#0: malloc: 00002B0E909E6010:5200000
2012/05/10 20:35:04 [notice] 1867#0: start worker process 1868
2012/05/10 20:35:04 [debug] 1867#0: sigsuspend
2012/05/10 20:35:04 [debug] 1868#0: malloc: 00002B0E90EDC010:5200000
2012/05/10 20:35:04 [debug] 1868#0: epoll add event: fd:6 op:1 ev:00000001
2012/05/10 20:35:04 [debug] 1868#0: epoll add event: fd:7 op:1 ev:00000001
2012/05/10 20:35:04 [debug] 1868#0: setproctitle: "nginx: worker process"
2012/05/10 20:35:04 [debug] 1868#0: worker cycle
2012/05/10 20:35:04 [debug] 1868#0: epoll timer: -1
2012/05/10 20:35:07 [debug] 1879#0: bind() 0.0.0.0:80 #6
2012/05/10 20:35:07 [debug] 1879#0: counter: 00002AB8E6B21080, 1
2012/05/10 20:35:07 [notice] 1867#0: signal 1 (SIGHUP) received, reconfiguring
2012/05/10 20:35:07 [debug] 1867#0: wake up, sigio 0
2012/05/10 20:35:07 [notice] 1867#0: reconfiguring
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003D562E0:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003E1A030:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D5A2F0:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 8, 0000000003D5A2F0, 2371, 0
2012/05/10 20:35:07 [debug] 1867#0: add cleanup: 0000000003D57C68
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D5C9D0:4280
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D5DA90:4280
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D5EB50:4280
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E1E040:4280
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E1F100:4280
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E201C0:4280
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003E21280:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E13D00:4096
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/mime.types
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/mime.types
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E25290:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 9, 0000000003E25290, 3463, 0
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E262A0:4096
2012/05/10 20:35:07 [debug] 1867#0: add cleanup: 0000000003E24BC0
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/*.conf
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/upstream-fair.conf
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E25290:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 9, 0000000003E25290, 411, 0
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003E272B0:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/ssl.conf
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E25290:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 9, 0000000003E25290, 466, 0
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/virtual.conf
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E25290:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 9, 0000000003E25290, 283, 0
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/server_param.conf
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E25290:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 9, 0000000003E25290, 19, 0
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/*_vhost
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/sites-enabled/*.conf
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/sites-enabled/default.conf
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E25290:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 9, 0000000003E25290, 628, 0
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003E2B2C0:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: ustats: using 5242880B of shared memory in /etc/nginx/sites-enabled/default.conf:22
2012/05/10 20:35:07 [debug] 1867#0: include fastcgi_params
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/fastcgi_params
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E2F2D0:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 10, 0000000003E2F2D0, 964, 0
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003E302E0:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/error_page.include
2012/05/10 20:35:07 [debug] 1867#0: include /etc/nginx/conf.d/error_page.include
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E2F2D0:4096
2012/05/10 20:35:07 [debug] 1867#0: read: 10, 0000000003E2F2D0, 92, 0
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D987D0:2048
2012/05/10 20:35:07 [debug] 1867#0: add cleanup: 0000000003E32EF0
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D689C0:304
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D68B00:104
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D68B70:120
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D51D80:1024
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D51D80:1024
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D51D80:1024
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D51D80:1024
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003E342F0:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D51D80:1024
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D51D80:1024
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D51D80:1024
2012/05/10 20:35:07 [debug] 1867#0: add cleanup: 0000000003E37190
2012/05/10 20:35:07 [debug] 1867#0: create perl interpreter
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003ECED20:4096
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E53E10:2048
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003ECED20:4096
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003ECED20:4096
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003ECED20:4096
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003ECED20:4096
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E53E10:1024
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003E53E10:1024
2012/05/10 20:35:07 [debug] 1867#0: posix_memalign: 0000000003ECED20:16384 @16
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003ED2D30:4864
2012/05/10 20:35:07 [debug] 1867#0: malloc: 0000000003D98BE0:368
2012/05/10 20:35:07 [debug] 1867#0: log: 0000000003D56550 8 "/var/log/nginx/error.log"
2012/05/10 20:35:07 [debug] 1867#0: log: 0000000003D56580 9 "/var/log/nginx/access.log"
2012/05/10 20:35:07 [notice] 1867#0: using the "epoll" event method
2012/05/10 20:35:07 [notice] 1867#0: start worker processes
2012/05/10 20:35:07 [debug] 1867#0: channel 4:5
2012/05/10 20:35:07 [notice] 1867#0: start worker process 1880
2012/05/10 20:35:07 [debug] 1867#0: pass channel s:1 pid:1880 fd:4 to s:0 pid:1868 fd:3
2012/05/10 20:35:07 [debug] 1880#0: eventfd: 11
2012/05/10 20:35:07 [debug] 1880#0: malloc: 0000000003D8D760:6144
2012/05/10 20:35:07 [debug] 1880#0: malloc: 00002B0E900DF010:9600000
2012/05/10 20:35:07 [debug] 1880#0: malloc: 00002B0E90A07010:5200000
2012/05/10 20:35:07 [debug] 1868#0: epoll: fd:7 ev:0001 d:00002B0E900BE0D0
2012/05/10 20:35:07 [debug] 1868#0: channel handler
2012/05/10 20:35:07 [debug] 1868#0: channel: 32
2012/05/10 20:35:07 [debug] 1868#0: channel command: 1
2012/05/10 20:35:07 [debug] 1868#0: get channel s:1 pid:1880 fd:3
2012/05/10 20:35:07 [debug] 1868#0: channel: -2
2012/05/10 20:35:07 [debug] 1868#0: timer delta: 3296
2012/05/10 20:35:07 [debug] 1868#0: posted events 0000000000000000
2012/05/10 20:35:07 [debug] 1868#0: worker cycle
2012/05/10 20:35:07 [debug] 1868#0: epoll timer: -1
2012/05/10 20:35:07 [debug] 1880#0: malloc: 00002B0E90EFD010:5200000
2012/05/10 20:35:07 [debug] 1880#0: epoll add event: fd:6 op:1 ev:00000001
2012/05/10 20:35:07 [debug] 1880#0: epoll add event: fd:5 op:1 ev:00000001
2012/05/10 20:35:07 [debug] 1880#0: setproctitle: "nginx: worker process"
2012/05/10 20:35:07 [debug] 1880#0: worker cycle
2012/05/10 20:35:07 [debug] 1880#0: epoll timer: -1
2012/05/10 20:35:07 [debug] 1867#0: child: 0 1868 e:0 t:0 d:0 r:1 j:0
2012/05/10 20:35:07 [debug] 1867#0: child: 1 1880 e:0 t:0 d:0 r:1 j:1
2012/05/10 20:35:07 [debug] 1867#0: sigsuspend
2012/05/10 20:35:07 [debug] 1868#0: epoll: fd:7 ev:0001 d:00002B0E900BE0D0
2012/05/10 20:35:07 [debug] 1868#0: channel handler
2012/05/10 20:35:07 [debug] 1868#0: channel: 32
2012/05/10 20:35:07 [debug] 1868#0: channel command: 3
2012/05/10 20:35:07 [debug] 1868#0: channel: -2
2012/05/10 20:35:07 [debug] 1868#0: timer delta: 102
2012/05/10 20:35:07 [debug] 1868#0: posted events 0000000000000000
2012/05/10 20:35:07 [notice] 1868#0: gracefully shutting down
2012/05/10 20:35:07 [debug] 1868#0: setproctitle: "nginx: worker process is shutting down"
2012/05/10 20:35:07 [debug] 1868#0: epoll del event: fd:6 op:2 ev:00000000
2012/05/10 20:35:07 [debug] 1868#0: close listening 0.0.0.0:80 #6
2012/05/10 20:35:07 [notice] 1868#0: exiting
2012/05/10 20:35:07 [debug] 1868#0: flush files
2012/05/10 20:35:07 [debug] 1868#0: run cleanup: 0000000003D79820
2012/05/10 20:35:07 [debug] 1868#0: run cleanup: 0000000003D75580
2012/05/10 20:35:07 [debug] 1868#0: cleanup resolver
2012/05/10 20:35:07 [debug] 1868#0: run cleanup: 0000000003D66D90
2012/05/10 20:35:07 [debug] 1868#0: open file cache cleanup
2012/05/10 20:35:07 [debug] 1868#0: run cleanup: 0000000003D54658
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003E18D20
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D68E80
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D66E60
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D61D90
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D60CD0
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D5FC10
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D522D0, unused: 0
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D62E50, unused: 1
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D69E90, unused: 0
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D6DEA0, unused: 0
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D71EB0, unused: 0
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003D75EC0, unused: 0
2012/05/10 20:35:07 [debug] 1868#0: free: 0000000003E14D10, unused: 11760
2012/05/10 20:35:07 [notice] 1868#0: exit
2012/05/10 20:35:07 [notice] 1867#0: signal 17 (SIGCHLD) received
2012/05/10 20:35:07 [notice] 1867#0: worker process 1868 exited with code 0
2012/05/10 20:35:07 [debug] 1867#0: shmtx forced unlock
2012/05/10 20:35:07 [debug] 1867#0: shmtx forced unlock
2012/05/10 20:35:07 [debug] 1867#0: shmtx forced unlock
2012/05/10 20:35:07 [debug] 1867#0: shmtx forced unlock
2012/05/10 20:35:07 [debug] 1880#0: epoll: fd:5 ev:0011 d:00002B0E900DF0D0
2012/05/10 20:35:07 [debug] 1880#0: epoll_wait() error on fd:5 ev:0011
2012/05/10 20:35:07 [debug] 1880#0: channel handler
2012/05/10 20:35:07 [debug] 1880#0: recvmsg() returned zero
2012/05/10 20:35:07 [debug] 1880#0: channel: -1
2012/05/10 20:35:07 [debug] 1880#0: epoll del connection: fd:5
2012/05/10 20:35:07 [debug] 1880#0: reusable connection: 0
2012/05/10 20:35:07 [debug] 1880#0: timer delta: 120
2012/05/10 20:35:07 [debug] 1880#0: posted events 0000000000000000
2012/05/10 20:35:07 [debug] 1880#0: worker cycle
2012/05/10 20:35:07 [debug] 1880#0: epoll timer: -1
Подскажите куда покапать.
Подробная информация о списке рассылки nginx-ru