nginx + haproxy + mongrel - issue persists

[Ezra Zygmuntowicz]

Asif-

	We are working on a new nginx balancer module that emulates haproxy's  
maxconns setting. So far it is testing out very well. Please give it a  
try and see if it might be the right solution for you:

http://github.com/ezmobius/nginx-ey-balancer/tree/master

Cheers-
-Ezra

On Dec 3, 2008, at 9:29 PM, Asif Ali wrote:

> We have configured nginx +  haproxy + mongrels [ more than 150  
> instances]. While it works perfectly fine for small configuration, a  
> larger set of mongrels - fail completely.
>
> I have attached the configuration file for your reference. Apologies  
> for the inconvenience if this is coming into the wrong list.
>
> Each of those servers are 16G RAM, Quad Core, Dual Processor  
> Machines by Dell. So - the memory shouldn't really be a problem.
>
> Although someone did mention that ip_conntrack module might be a  
> problem.
>
> I am not sure what the issue is and not able to understand  - why  
> haproxy is unable to route requests.
>
> Can you please tell me if there could be some other issue? All the  
> servers are marked DOWN even through they're up
>
>
>
> Nov 21 14:08:46 mw-server9 haproxy[323]: Server rails_proxy/mon170  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:08:46 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:08:49 mw-server9 haproxy[323]: Server rails_proxy/mon078  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:08:49 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:08:54 mw-server9 haproxy[323]: Server rails_proxy/mon166  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:08:54 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:08:54 mw-server9 haproxy[323]: Server rails_proxy/mon167  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:08:54 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:08:56 mw-server9 haproxy[323]: Server rails_proxy/mon081  
> is DOWN. 1 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:08:56 mw-server9 haproxy[323]: Server rails_proxy/mon089  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:08:56 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:09:01 mw-server9 haproxy[323]: Server rails_proxy/mon155  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:09:01 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:09:01 mw-server9 haproxy[323]: Server rails_proxy/mon074  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:09:01 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:09:04 mw-server9 haproxy[323]: Server rails_proxy/mon124  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:09:04 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:09:04 mw-server9 haproxy[323]: Server rails_proxy/mon162  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:09:04 mw-server9 haproxy[323]: Proxy rails_proxy has no  
> server available !
> Nov 21 14:09:04 mw-server9 haproxy[323]: Server rails_proxy/mon142  
> is DOWN. 0 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue
> Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon090  
> is DOWN. 74 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon095  
> is DOWN. 73 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon118  
> is DOWN. 72 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon079  
> is DOWN. 71 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon096  
> is DOWN. 70 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon162  
> is DOWN. 69 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue.
> Nov 21 14:10:16 mw-server9 haproxy[323]: Server rails_proxy/mon125  
> is DOWN. 68 active and 0 backup servers left. 0 sessions active, 0  
> requeued, 0 remaining in queue

Ezra Zygmuntowicz
ez at engineyard.com