<div dir="ltr">Hello,<div><br></div><div style>Thank you all for your support.</div><div><br></div><div style><b>Mex: </b></div><div style><b><span style="font-family:arial,sans-serif;font-size:13px">1) is the setup of your vmware similar to you ec2 - instance? i talk esp. about </span><span style="font-family:arial,sans-serif;font-size:13px">RAM/CPU-power </span><span style="font-family:arial,sans-serif;font-size:13px">here.</span></b><br style="font-family:arial,sans-serif;font-size:13px">
Yes, i've setup the vmware machine to be 1.7 G in ram and 1 core just like the small ec2 instance.</div><div style><br><b><span style="font-family:arial,sans-serif;font-size:13px">2) do you have a monitoring on your instances, checking for load/ram-zusage, </span><span style="font-family:arial,sans-serif;font-size:13px">iowait etc?</span></b><br style="font-family:arial,sans-serif;font-size:13px">
What goes on here is that my CPU usage per uwsgi process is around 13% and server load starts to get much higher. MySQL operations usually take 6-8 ms which are optimized and not slowing the app down. once the load starts rising, the app slows down and more connections start to fail.</div>
<div style><br></div><div style><span style="font-family:arial,sans-serif;font-size:13px"><b>Jan-Philip:</b></span><br><b><span style="font-family:arial,sans-serif;font-size:13px">Do you run the benchmark program on the same virtual machine as the web stack?? For yielding conclusive results, you certainly don't want to make ab, nginx, and all other entities involved compete for the same CPU.</span><br style="font-family:arial,sans-serif;font-size:13px">
</b>Yes, on both machines i try to run ab on the same machine. So that i am profiling the app from within taking away any network latency that can affect the response rate. I tried running the test from a linode machine to an EC2 instance... same results.<br style="font-family:arial,sans-serif;font-size:13px">
<br style="font-family:arial,sans-serif;font-size:13px"><font face="arial, sans-serif">Again, thank you for your support, i am persevering on this until i find out what the issue is.</font></div></div><div class="gmail_extra">
<br clear="all"><div><div dir="ltr">Best Regards,<div><br><b>Rakan AlHneiti</b><div>Find me on the internet:</div><div><a href="http://www.facebook.com/rakan.alhneiti" style="font-size:x-small" target="_blank"><img src="http://rakan.me/wp-content/uploads/facebook_16.png"> Rakan Alhneiti</a><span style="color:rgb(102,102,102);font-size:x-small;background-color:rgb(255,255,255)"> | </span><a href="https://twitter.com/rakanalh" style="font-size:x-small" target="_blank"><img src="http://rakan.me/wp-content/uploads/twitter_16.png"> @rakanalh</a><span style="color:rgb(102,102,102);font-size:x-small;background-color:rgb(255,255,255)"> | </span><a href="http://www.linkedin.com/in/rakanalhneiti" style="font-size:x-small" target="_blank"><img src="http://rakan.me/wp-content/uploads/linkedin_16.png"> Rakan Alhneiti</a><span style="color:rgb(102,102,102);font-size:x-small;background-color:rgb(255,255,255)"> | </span><img src="http://rakan.me/wp-content/uploads/skype_16.png" style="color:rgb(102,102,102);font-size:x-small"><span style="color:rgb(102,102,102);font-size:x-small;background-color:rgb(255,255,255)"> </span><span style="color:rgb(102,102,102);font-size:x-small;background-color:rgb(255,255,255)">alhneiti</span></div>
<div><font color="#666666" size="1"><br></font>----- GTalk <a href="mailto:rakan.alhneiti@gmail.com" target="_blank">rakan.alhneiti@gmail.com</a><br>----- Mobile: +962-798-910 990</div><div><br><img src="http://www.zend.com/topics/php5-zce-logo-new.gif"></div>
</div></div></div>
<br><br><div class="gmail_quote">On Thu, Feb 21, 2013 at 11:00 AM, Jan-Philip Gehrcke <span dir="ltr"><<a href="mailto:jgehrcke@googlemail.com" target="_blank">jgehrcke@googlemail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Do you run the benchmark program on the same virtual machine as the web stack?? For yielding conclusive results, you certainly don't want to make ab, nginx, and all other entities involved compete for the same CPU.<br>
<br>
If yes, try running ab from a different machine in the same network (make sure your network is not the bottle neck here) and compare your results again.<br>
<br>
Cheers,<br>
<br>
Jan-Philip<div class="im"><br>
<br>
<br>
<br>
On 02/20/2013 09:13 PM, Rakan Alhneiti wrote:<br>
</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
Hello,<br>
<br>
I am running a django app with nginx & uwsgi on an amazon ec2 instance<br>
and a vmware machine almost the same size as the ec2 one. Here's how i<br>
run uwsgi:<br>
<br>
<br></div>
|sudo uwsgi-b25000 --chdir=/www/python/apps/<u></u>pyapp--module=wsgi:<u></u>application--env DJANGO_SETTINGS_MODULE=<u></u>settings--socket=/tmp/pyapp.<u></u>socket--cheaper=8 --processes=16 --harakiri=10 --max-requests=5000 --vacuum--master--pidfile=/<u></u>tmp/pyapp-master.pid--uid=220 --gid=499|<div class="im">
<br>
<br>
& nginx configurations:<br>
<br>
<br>
|server{<br>
listen80;<br>
server_name <a href="http://test.com" target="_blank">test.com</a><br>
<br>
root/www/python/apps/pyapp/;<br>
<br>
access_log/var/log/nginx/test.<u></u>com.access.log;<br>
error_log/var/log/nginx/test.<u></u>com.error.log;<br>
<br>
#<a href="https://docs.djangoproject.com/en/dev/howto/static-files/#serving-static-files-in-production" target="_blank">https://docs.djangoproject.<u></u>com/en/dev/howto/static-files/<u></u>#serving-static-files-in-<u></u>production</a><br>
location/static/ {<br>
alias /www/python/apps/pyapp/static/<u></u>;<br>
expires30d;<br>
}<br>
<br>
location/media/ {<br>
alias /www/python/apps/pyapp/media/;<br>
expires30d;<br>
}<br>
<br>
location/ {<br>
uwsgi_pass unix:///tmp/pyapp.socket;<br>
include uwsgi_params;<br>
proxy_read_timeout120;<br>
}<br>
<br>
# what to serve if upstream is not available or crashes<br>
#error_page 500 502 503 504 /media/50x.html;<br>
}|<br>
<br>
Here comes the problem. When doing "ab" (ApacheBenchmark) on both<br>
machines i get the following results: (vmware machine being almost the<br>
same size as the ec2 small instance)<br>
<br></div>
*Amazon EC2:*<div class="im"><br>
<br>
nginx version: nginx version: nginx/1.2.6<br>
<br>
uwsgi version:1.4.5<br>
<br>
<br>
|Concurrency Level: 500<br></div>
Time takenfor tests: 21.954 seconds<div class="im"><br>
Complete requests: 5000<br>
Failed requests: 126<br>
(Connect: 0, Receive: 0, Length: 126, Exceptions: 0)<br>
Write errors: 0<br>
Non-2xx responses: 4874<br>
Total transferred: 4142182 bytes<br>
HTML transferred: 3384914 bytes<br>
Requests per second: 227.75 [#/sec] (mean)<br>
Time per request: 2195.384 [ms] (mean)<br>
Time per request: 4.391 [ms] (mean, across all concurrent requests)<br>
Transfer rate: 184.25 [Kbytes/sec] received|<br>
<br></div><div class="im">
*Vmware machine (CentOS 6):*<br>
<br></div><div class="im">
nginx version: nnginx version: nginx/1.0.15<br>
<br>
uwsgi version: 1.4.5<br>
<br>
<br>
|Concurrency Level: 1000<br></div>
Time takenfor tests: 1.094 seconds<div class="im"><br>
Complete requests: 5000<br>
Failed requests: 0<br>
Write errors: 0<br>
Total transferred: 30190000 bytes<br>
HTML transferred: 28930000 bytes<br>
Requests per second: 4568.73 [#/sec] (mean)<br>
Time per request: 218.879 [ms] (mean)<br>
Time per request: 0.219 [ms] (mean, across all concurrent requests)<br>
Transfer rate: 26939.42 [Kbytes/sec] received|<br>
<br>
As you can see... all requests on the ec2 instance fail with either<br>
timeout errors or "Client prematurely disconnected". However, on my<br>
vmware machine all requests go through with no problems. The other thing<br>
is the difference in reqs / second i am doing on both machines.<br>
<br>
What am i doing wrong on ec2?<br>
<br>
<br>
<br>
<br></div><div class="im">
______________________________<u></u>_________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/<u></u>mailman/listinfo/nginx</a><br>
<br>
</div></blockquote><div class="HOEnZb"><div class="h5">
<br>
______________________________<u></u>_________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/<u></u>mailman/listinfo/nginx</a><br>
</div></div></blockquote></div><br></div>