nginx - workers segfaulting

[Maxim Dounin]

Hello!

On Mon, Dec 02, 2013 at 01:15:25PM -0500, nmarques wrote:

> Dear All,
> 
> I'm facing a small problem with NGINX; The workers are segfaulting since
> 11:20 this morning. From kernel messages I got soemthing like this:
> 
> nginx[6888]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6886]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6890]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6889]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6892]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6893]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6894]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6891]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> nginx[6896]: segfault at 8 ip 0000000000426a30 sp 00007fff85c01e70 error 4
> in nginx[400000+a8000]
> 
> The log files show the following:
> 
> 2013/12/02 18:13:53 [alert] 26876#0: worker process 30412 exited on signal
> 11
> 2013/12/02 18:13:53 [alert] 26876#0: worker process 30414 exited on signal
> 11
> 2013/12/02 18:13:53 [alert] 26876#0: worker process 30413 exited on signal
> 11
> 2013/12/02 18:13:54 [alert] 26876#0: worker process 30418 exited on signal
> 11
> 2013/12/02 18:13:55 [info] 30417#0: *14388 client closed connection while
> SSL handshaking, client: 10.192.41.251, server: 0.0.0.0:4443
> 2013/12/02 18:13:56 [info] 30417#0: *14389 client closed connection while
> waiting for request, client: 10.192.41.252, server: 0.0.0.0:80
> 2013/12/02 18:13:56 [info] 30417#0: *14390 client closed connection while
> SSL handshaking, client: 10.192.41.252, server: 0.0.0.0:2443
> 2013/12/02 18:13:57 [info] 30417#0: *14397 client closed connection while
> SSL handshaking, client: 10.192.41.252, server: 0.0.0.0:4443
> 2013/12/02 18:13:57 [info] 30417#0: *14403 client closed connection while
> waiting for request, client: 10.192.41.251, server: 0.0.0.0:80
> 2013/12/02 18:13:57 [info] 30417#0: *14402 client closed connection while
> SSL handshaking, client: 10.192.41.251, server: 0.0.0.0:2443
> 
> I can provide some cores, but I can't attach them here. My setup was running
> fine till today (which has some coincidence with a new webservice
> deployed).
> 
> Please could you provide some extra information on how to further debug this
> issue ?

>From the messages I suspect you are hitting this bug:

http://trac.nginx.org/nginx/ticket/235

Please follow suggested workaround to see if it helps (i.e., move 
the "ssl_session_cache" directive to http{} level or use the same 
value in all server{} blocks listening on the same socket).

If it doesn't help, please follow debugging hints here:

http://wiki.nginx.org/Debugging

-- 
Maxim Dounin
http://nginx.org/en/donation.html