<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>Sounds like at this point this discussion needs to be moved off the nginx mailing list. <br></div><div><br>On Jan 31, 2016, at 10:48, shahzaib shahzaib <<a href="mailto:shahzaib.cb@gmail.com">shahzaib.cb@gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div><div dir="ltr"><p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">The server is using ports 18 and 19 and those port are configured with speed 1000</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">LH26876_SW2#sh run int g 0/18</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">!</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">interface GigabitEthernet 0/18</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">description LH28765_3</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">no ip address</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"><span style="background:yellow">speed 1000</span></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">!</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">port-channel-protocol LACP</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"> port-channel 3 mode active</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">no shutdown</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">LH26876_SW2#sh run int g 0/19</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">!</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">interface GigabitEthernet 0/19</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">description LH28765_3</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">no ip address</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"><span style="background:yellow">speed 1000</span></span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">!</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">port-channel-protocol LACP</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"> port-channel 3 mode active</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">no shutdown</span></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">LH26876_SW2#</span></p><p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)"><br></span></p><p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">------------------------------</span></p><p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">Is it alright ?<br><br>Regards.</span></p><p class="MsoNormal"><span style="font-size:10pt;font-family:Verdana,sans-serif;color:rgb(31,73,125)">Shahzaib</span></p><input name="virtru-metadata" type="hidden" value="{"email-policy":{"state":"closed","expirationUnit":"days","disableCopyPaste":false,"disablePrint":false,"disableForwarding":false,"expires":false},"attachments":{}}"></div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jan 31, 2016 at 11:18 PM, shahzaib shahzaib <span dir="ltr"><<a href="mailto:shahzaib.cb@gmail.com" target="_blank">shahzaib.cb@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<input name="virtru-metadata" type="hidden" value="{"email-policy":{"state":"closed","expirationUnit":"days","disableCopyPaste":false,"disablePrint":false,"disableForwarding":false,"expires":false},"attachments":{}}"><div><br></div><div>Thanks a lot for response. Now i am doubting that issue is on network layer as i can examine lots of retransmitted packets in netstat -s output. Here is the server's status :<br><br><a href="http://prntscr.com/9xa6z2" target="_blank">http://prntscr.com/9xa6z2</a><br>
<br>Following is the thread with same mentioned issue :<br>
<br>
<a href="http://serverfault.com/questions/218101/freebsd-8-1-unstable-network-connection" target="_blank">http://serverfault.com/questions/218101/freebsd-8-1-unstable-network-connection</a><br>
<br>
This is what he said in thread :<br>
<br>
"<span style="color:rgb(34,36,38);line-height:19.5px">I
ran into a problem with Cisco Switchs forcing Negotiation of
network speeds. This caused intermittent errors and
retransmissions. The result was file transfers being really slow.
May not be the cases, but you can turn of speed negotiation with
miitools (if I recall correctly, been a long time).</span>"<br></div><div><br></div><div>>><span style="font-size:12.8px">Can you replicate using ftp, scp?<br>Yes, we recently tried downloading file over FTP and encountered the same slow transfer rate.</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">>></span><span style="font-size:12.8px">What's the output of zpool iostat (and the overal zpool/zfs configuration)?</span><span style="font-size:12.8px">Also do you have ZFS on top of hardware raid ? </span><span style="font-size:12.8px">In general just 12 SATA disks won't have a lot of IOps (especially random read) unless it all hits ZFS Arc (can/should be monitored), even more if there is a hardware raid underneath (in your place would flash the HBA with IT firmware so you get plain jbods managed by ZFS).</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">zpool iostat is quite stable yet. We're using HBA LSI-9211 , so its not hardware controller as FreeBSD recommends to use HBA in order to directly access all drives for scrubbing and data-integrity purposes. Do you recommend Hardware-Raid ? Following is the scrnshot of ARC status :</span><br><br><span style="font-size:12.8px"><a href="http://prntscr.com/9xaf9p" target="_blank">http://prntscr.com/9xaf9p</a></span><br></div><span class=""><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">>></span><span style="font-size:12.8px">How is your switch configured? How are the links negotiated, make sure both sides of both links are full duplex 1gig. Look for crc or input errors on the interface side.</span></div></span><div>On My side, i can see that both interfaces have Fully-Duplex port. Regarding crc / input errors, is there any command i can use to check that on FreeBSD ?</div><div><br></div><div>Regards.</div><span class="HOEnZb"><font color="#888888"><div>Shahzaib</div><div><br></div></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jan 31, 2016 at 11:04 PM, Payam Chychi <span dir="ltr"><<a href="mailto:pchychi@gmail.com" target="_blank">pchychi@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>Hi,</div><div><br></div><div>Forget the application layer being the problem until you have successfully replicated the problem in several different setups.</div><div><br></div><div>Are you monitoring both links utilization levels? Really sounds like a network layer problem or something with your ip stack.</div><div><br></div><div>Can you replicate using ftp, scp?</div><div><br></div><div>How is your switch configured? How are the links negotiated, make sure both sides of both links are full duplex 1gig. Look for crc or input errors on the interface side.</div><div><br></div><div>How many packets are you pushing? Make sure the switch isnt activating unicast limiting.</div><div><br></div><div>Lots of things to check... Would help if you can help us understand what tests youve done to determine its nginx.</div><div><br></div><div>Thanks</div><span><font color="#888888">
<div><div><br></div>-- <br>Payam Chychi<br>Network Engineer / Security Specialist<div><br></div></div></font></span><div><div>
<p style="color:#a0a0a8">On Sunday, January 31, 2016 at 9:33 AM, Reinis Rozitis wrote:</p>
<blockquote type="cite" style="border-left-style:solid;border-width:1px;margin-left:0px;padding-left:10px">
<div><div><div>This is a bit out of scope of nginx but ..</div><div><br></div><blockquote type="cite"><div>could be network issue or LACP issue but doesn't looks like it is</div></blockquote><div><br></div><div>How did you determine this?</div><div>Can you generate more than 1 Gbps (without nginx)?</div><div><br></div><div><br></div><blockquote type="cite"><div><div>12 x 3TB SATA Raid-10 (HBA LSI-9211)</div><div>ZFS FileSystem with 18TB usable space</div></div></blockquote><div><br></div><blockquote type="cite"><div><div>Please i need guidance to handle with this problem, i am sure that some </div><div>value needs to tweak.</div></div></blockquote><div><br></div><div>What's the output of zpool iostat (and the overal zpool/zfs configuration)?</div><div><br></div><div>Also do you have ZFS on top of hardware raid ?</div><div><br></div><div>In general just 12 SATA disks won't have a lot of IOps (especially random </div><div>read) unless it all hits ZFS Arc (can/should be monitored), even more if </div><div>there is a hardware raid underneath (in your place would flash the HBA with </div><div>IT firmware so you get plain jbods managed by ZFS).</div><div><br></div><div>rr </div><div><br></div><div>_______________________________________________</div><div>nginx mailing list</div><div><a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a></div><div><a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/mailman/listinfo/nginx</a></div></div></div>
</blockquote>
<div>
<br>
</div>
</div></div><br>_______________________________________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" rel="noreferrer" target="_blank">http://mailman.nginx.org/mailman/listinfo/nginx</a><br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>nginx mailing list</span><br><span><a href="mailto:nginx@nginx.org">nginx@nginx.org</a></span><br><span><a href="http://mailman.nginx.org/mailman/listinfo/nginx">http://mailman.nginx.org/mailman/listinfo/nginx</a></span></div></blockquote></body></html>