<div dir="ltr"><div>Hey Lucas, your assumption seems to be correct. According to /proc/interrupts the following stats are significantly higher for those two cores (CPU5, CPU6 - 0-based indexing):</div><div><br></div><div>- CPU5: xen-percpu-ipi callfuncsingle5</div><div>- CPU6: xen-percpu-ipi callfuncsingle6<br>- CPU5: xen-pirq-msi-x eth0-TxRx-0<br>- CPU6: xen-pirq-msi-x eth0-TxRx-1<br>- CPU5,6: TLB shootdowns<br>- CPU5,6: Hypervisor callback interrupts<br><br></div>Is this something that can and should be optimized or is it simply a matter of fact due to the high load on the (fixed) available network card capacity?<br><div><div><div><br></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jan 11, 2018 at 11:16 AM, Lucas Rolff <span dir="ltr"><<a href="mailto:lucas@lucasrolff.com" target="_blank">lucas@lucasrolff.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="white" link="blue" vlink="purple" lang="EN-GB">
<div class="m_501132572574067029WordSection1">
<p class="MsoNormal">If it’s the same two cores, it might be another process that uses the same two cores and thus happens to max out.<u></u><u></u></p>
<p class="MsoNormal">One very likely possibility would be interrupts from e.g. networking. You can check /proc/interrupts to see where interrupts from the network happens.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="margin-left:36.0pt"><b><span style="font-size:12.0pt;color:black">From:
</span></b><span style="font-size:12.0pt;color:black">nginx <<a href="mailto:nginx-bounces@nginx.org" target="_blank">nginx-bounces@nginx.org</a>> on behalf of Raffael Vogler <<a href="mailto:raffael.vogler@yieldlove.com" target="_blank">raffael.vogler@yieldlove.com</a>><br>
<b>Reply-To: </b>"<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a>" <<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a>><br>
<b>Date: </b>Thursday, 11 January 2018 at 11.14<br>
<b>To: </b>"<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a>" <<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a>><br>
<b>Subject: </b>2 of 16 cores are constantly maxing out - how to balance the load?<u></u><u></u></span></p>
</div><div><div class="h5">
<div>
<p class="MsoNormal" style="margin-left:36.0pt"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-left:36.0pt">Hello!<br>
<br>
I have nginx with php-fpm running on a 16 core Ubuntu 16.04 instance. The server is handling more than 10 million requests per hour.<br>
<br>
<a href="https://imgur.com/a/iRZ7V" target="_blank">https://imgur.com/a/iRZ7V</a><u></u><u></u></p>
<div>
<div>
<p style="margin-left:36.0pt">As you can see on the htop screenshot cores 6 and 7 are maxed out and that's the case constantly - even after restarting nginx those two cores stay at that level.
<u></u><u></u></p>
<p style="margin-left:36.0pt">I wonder why is that so and how to balance the load more evenly?<u></u><u></u></p>
<p style="margin-left:36.0pt">Also I'm curious to know whether this might indicate a performance relevant issue or if it is most likely harmless and just looks odd.<u></u><u></u></p>
<pre style="margin-left:36.0pt"><code>> cat /etc/nginx/nginx.conf | grep -v '^\s*#'<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code><u></u> <u></u></code></pre>
<pre style="margin-left:36.0pt"><code>user www-data;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code>worker_processes auto;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code>pid /run/nginx.pid;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code>events {<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> worker_connections 768;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code>}<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code>http {<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> sendfile on;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> tcp_nopush on;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> tcp_nodelay on;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> keepalive_timeout 65;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> types_hash_max_size 2048;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> include /etc/nginx/mime.types;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> default_type application/octet-stream;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> ssl_protocols TLSv1 TLSv1.1 TLSv1.2; # Dropping SSLv3, ref: POODLE<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> ssl_prefer_server_ciphers on;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> access_log /var/log/nginx/access.log;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> error_log /var/log/nginx/error.log;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> gzip on;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> gzip_disable "msie6";<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> include /etc/nginx/conf.d/*.conf;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code> include /etc/nginx/sites-enabled/*;<u></u><u></u></code></pre>
<pre style="margin-left:36.0pt"><code>}</code><u></u><u></u></pre>
<pre style="margin-left:36.0pt"><code><span style="font-family:"Arial",sans-serif">Thanks</span></code><u></u><u></u></pre>
<pre style="margin-left:36.0pt"><code><span style="font-family:"Arial",sans-serif">Raffael</span></code><u></u><u></u></pre>
</div>
</div>
</div>
</div></div></div>
</div>
<br>______________________________<wbr>_________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" rel="noreferrer" target="_blank">http://mailman.nginx.org/<wbr>mailman/listinfo/nginx</a><br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><span style="color:rgb(68,68,68);font-size:x-small">Raffael Vogler, Chief Technology Officer</span><br style="color:rgb(68,68,68);font-size:x-small"><img src="https://docs.google.com/a/yieldlove.com/uc?id=0BxS4TYtHE4wCVEZiMFdwZm9vWHc&export=download" style="color:rgb(68,68,68);font-size:x-small"><br style="color:rgb(68,68,68);font-size:x-small"><span style="color:rgb(68,68,68);font-size:x-small">Yieldlove GmbH</span><br style="color:rgb(68,68,68);font-size:x-small"><span style="color:rgb(68,68,68);font-size:x-small">Neuer Pferdemarkt 1, 20359 Hamburg </span><br style="color:rgb(68,68,68);font-size:x-small"><br style="color:rgb(68,68,68);font-size:x-small"><a href="http://www.yieldlove.com" target="_blank">www.yieldlove.com<br style="color:rgb(68,68,68);font-size:x-small"></a><br style="color:rgb(68,68,68);font-size:x-small"><span style="color:rgb(68,68,68);font-size:x-small"><a href="mailto:raffael.vogler@yieldlove.com" target="_blank">raffael.vogler@yieldlove.com</a></span><br style="color:rgb(68,68,68);font-size:x-small"><font size="1"><a href="https://www.xing.com/profile/Raffael_Vogler" target="_blank">XING</a> - <a href="https://www.linkedin.com/in/raffaelvogler" target="_blank">LinkedIn</a></font> <br style="color:rgb(68,68,68);font-size:x-small"><span style="color:rgb(68,68,68);font-size:x-small">Skype: joyofdata <br></span></div><div dir="ltr"><br style="color:rgb(68,68,68);font-size:x-small"><span style="color:rgb(68,68,68);font-size:x-small">Registernummer: HRB 127559; Registergericht: Amtsgericht Hamburg; USt-ID: DE815426709; Geschäftsführung:Benjamin Gries, Timo Hagenow, Ivan Tomic</span><br></div></div></div></div>
</div>