<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 8, 2018 at 3:11 PM, Igor A. Ippolitov <span dir="ltr"><<a href="mailto:iippolitov@nginx.com" target="_blank">iippolitov@nginx.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div class="m_7437294295156398557moz-cite-prefix">Sorry, didn't realize this is an
English mailing list.<br>
<br>
To sum it up: the problem is most likely about clients and not the
server.<br>
Discrepancy between request time and upstream time usually means
that a client is slow or uses a bad connection.<br>
Basically, this is OK unless you have the only server out of many
with this problem. <br>
This in turn may mean that the problem is with that server's
network connection.<br></div></div></blockquote><div><br></div><div><br></div><div>The issue affects all of our primary nginx servers.</div><div><br></div><div>However, they receive requests from 4 "routing" nginx servers and all backends via haproxy. The problem affects only</div><div>requests from the routing nginxs, not backends. I would expect routing servers pull data from upstream ASAP. So slow</div><div>clients in my mind should only affect those routing servers standing in front.</div><div><br></div><div>Am I wrong?</div><div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div text="#000000" bgcolor="#FFFFFF"><div class="m_7437294295156398557moz-cite-prefix">
<br>
Regards.<div><div class="h5"><br>
<br>
On 08.05.2018 14:50, Igor A. Ippolitov wrote:<br>
</div></div></div><div><div class="h5">
<blockquote type="cite">
<div class="m_7437294295156398557moz-cite-prefix">Можно я отвечу ссылкой? <a class="m_7437294295156398557moz-txt-link-freetext" href="http://mailman.nginx.org/pipermail/nginx/2008-October/008025.html" target="_blank">http://mailman.nginx.org/<wbr>pipermail/nginx/2008-October/<wbr>008025.html</a><br>
Проблема, скорее всего, в клиентах.<br>
<br>
On 08.05.2018 14:43, Руслан Закиров wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hello,
<div><br>
</div>
<div>Some selected log records: </div>
<div>
<div>14:27:46 1.609 [0.013] [0.002] [<a href="http://192.168.1.44:5002" target="_blank">192.168.1.44:5002</a>]</div>
<div>14:27:50 1.017 [0.017] [0.001] [<a href="http://192.168.1.24:9000" target="_blank">192.168.1.24:9000</a>]</div>
<div>14:27:51 1.522 [0.021] [0.000] [<a href="http://192.168.1.92:9000" target="_blank">192.168.1.92:9000</a>]</div>
<div>14:27:50 1.019 [0.019] [0.000] [<a href="http://192.168.1.41:9000" target="_blank">192.168.1.41:9000</a>]</div>
<div>14:27:52 1.019 [0.018] [0.000] [<a href="http://192.168.1.49:9000" target="_blank">192.168.1.49:9000</a>]</div>
<div>14:27:52 1.019 [0.018] [0.001] [<a href="http://192.168.1.59:9000" target="_blank">192.168.1.59:9000</a>]</div>
<div>14:27:55 1.515 [0.014] [0.000] [<a href="http://192.168.1.92:9000" target="_blank">192.168.1.92:9000</a>]</div>
<div>14:27:57 0.510 [0.010] [0.001] [<a href="http://192.168.1.21:9000" target="_blank">192.168.1.21:9000</a>]</div>
<div>14:28:03 1.521 [0.021] [0.001] [<a href="http://192.168.1.48:9000" target="_blank">192.168.1.48:9000</a>]</div>
<div>14:28:04 0.660 [0.007] [0.002] [<a href="http://192.168.1.24:5002" target="_blank">192.168.1.24:5002</a>]</div>
<div>14:28:05 2.216 [0.018] [0.002] [<a href="http://192.168.1.44:5002" target="_blank">192.168.1.44:5002</a>]</div>
<div>14:28:11 0.510 [0.010] [0.000] [<a href="http://192.168.1.49:9000" target="_blank">192.168.1.49:9000</a>]</div>
<div>14:28:26 0.937 [0.008] [0.002] [<a href="http://192.168.1.92:5002" target="_blank">192.168.1.92:5002</a>]</div>
<div>14:28:28 1.019 [0.019] [0.000] [<a href="http://192.168.1.49:9000" target="_blank">192.168.1.49:9000</a>]</div>
<div>14:28:28 0.508 [0.007] [0.000] [<a href="http://192.168.1.42:9000" target="_blank">192.168.1.42:9000</a>]</div>
<div>14:28:31 1.021 [0.019] [0.000] [<a href="http://192.168.1.44:9000" target="_blank">192.168.1.44:9000</a>]</div>
<div>14:28:32 0.509 [0.008] [0.000] [<a href="http://192.168.1.48:9000" target="_blank">192.168.1.48:9000</a>]</div>
<div>14:28:36 1.015 [0.015] [0.000] [<a href="http://192.168.1.43:9000" target="_blank">192.168.1.43:9000</a>]</div>
<div>14:28:39 0.358 [0.007] [0.001] [<a href="http://192.168.1.92:5002" target="_blank">192.168.1.92:5002</a>]</div>
<div><br>
</div>
<div>columns: wallclock time, request time,
upstream_request_time, upstream_connect_time, upstream.</div>
<div><br>
</div>
<div>Please, help me diagnose this problem further as I
stuck. This is subset where request_time 50x bigger than
upstream_request_time (just to make subset less noisy). I
see request times up to 60 seconds. Can not tie it to some
periodicity. It happens so often that don't see anything
helpful in strace... I stuck... Any ideas?</div>
<div><br>
</div>
<div>This is nginx/1.10.2 on FreeBSD 10.3-RELEASE-p7.</div>
<div><br>
</div>
-- <br>
<div class="m_7437294295156398557gmail_signature">
<div dir="ltr">
<div>Руслан Закиров</div>
<div>Руководитель отдела разработки веб-сервисов</div>
<div><span>+7(916) 597-92-69</span>, <span>ruz @ <a href="http://www.sports.ru/" target="_blank"><img src="http://farm7.static.flickr.com/6235/6210250811_19a888dbba_o.jpg" style="vertical-align:bottom;margin-right:0px" height="14" width="43"></a></span></div>
</div>
</div>
</div>
</div>
<br>
<fieldset class="m_7437294295156398557mimeAttachmentHeader"></fieldset>
<br>
<pre>______________________________<wbr>_________________
nginx mailing list
<a class="m_7437294295156398557moz-txt-link-abbreviated" href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a>
<a class="m_7437294295156398557moz-txt-link-freetext" href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/<wbr>mailman/listinfo/nginx</a></pre>
</blockquote>
<p><br>
</p>
<br>
<fieldset class="m_7437294295156398557mimeAttachmentHeader"></fieldset>
<br>
<pre>______________________________<wbr>_________________
nginx mailing list
<a class="m_7437294295156398557moz-txt-link-abbreviated" href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a>
<a class="m_7437294295156398557moz-txt-link-freetext" href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/<wbr>mailman/listinfo/nginx</a></pre>
</blockquote>
<p><br>
</p>
</div></div></div>
<br>______________________________<wbr>_________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" rel="noreferrer" target="_blank">http://mailman.nginx.org/<wbr>mailman/listinfo/nginx</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Руслан Закиров</div><div>Руководитель отдела разработки веб-сервисов</div><div><span>+7(916) 597-92-69</span>, <span>ruz @ <a href="http://www.sports.ru/" target="_blank"><img src="http://farm7.static.flickr.com/6235/6210250811_19a888dbba_o.jpg" width="43" height="14" style="vertical-align:bottom;margin-right:0px"></a></span></div></div></div>
</div></div>