<div dir="ltr">Hi,<input name="virtru-metadata" type="hidden" value="{"email-policy":{"state":"closed","expirationUnit":"days","disableCopyPaste":false,"disablePrint":false,"disableForwarding":false,"expires":false},"attachments":{}}"><div><br></div><div>Thanks a lot for response. Now i am doubting that issue is on network layer as i can examine lots of retransmitted packets in netstat -s output. Here is the server's status :<br><br><a class="" href="http://prntscr.com/9xa6z2">http://prntscr.com/9xa6z2</a><br>
<br>Following is the thread with same mentioned issue :<br>
<br>
<a class="" href="http://serverfault.com/questions/218101/freebsd-8-1-unstable-network-connection">http://serverfault.com/questions/218101/freebsd-8-1-unstable-network-connection</a><br>
<br>
This is what he said in thread :<br>
<br>
"<span style="color:rgb(34,36,38);line-height:19.5px">I
ran into a problem with Cisco Switchs forcing Negotiation of
network speeds. This caused intermittent errors and
retransmissions. The result was file transfers being really slow.
May not be the cases, but you can turn of speed negotiation with
miitools (if I recall correctly, been a long time).</span>"<br></div><div><br></div><div>>><span style="font-size:12.8px">Can you replicate using ftp, scp?<br>Yes, we recently tried downloading file over FTP and encountered the same slow transfer rate.</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">>></span><span style="font-size:12.8px">What's the output of zpool iostat (and the overal zpool/zfs configuration)?</span><span style="font-size:12.8px">Also do you have ZFS on top of hardware raid ? </span><span style="font-size:12.8px">In general just 12 SATA disks won't have a lot of IOps (especially random read) unless it all hits ZFS Arc (can/should be monitored), even more if there is a hardware raid underneath (in your place would flash the HBA with IT firmware so you get plain jbods managed by ZFS).</span></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">zpool iostat is quite stable yet. We're using HBA LSI-9211 , so its not hardware controller as FreeBSD recommends to use HBA in order to directly access all drives for scrubbing and data-integrity purposes. Do you recommend Hardware-Raid ? Following is the scrnshot of ARC status :</span><br><br><span style="font-size:12.8px"><a href="http://prntscr.com/9xaf9p">http://prntscr.com/9xaf9p</a></span><br></div><div><span style="font-size:12.8px"><br></span></div><div><span style="font-size:12.8px">>></span><span style="font-size:12.8px">How is your switch configured? How are the links negotiated, make sure both sides of both links are full duplex 1gig. Look for crc or input errors on the interface side.</span></div><div>On My side, i can see that both interfaces have Fully-Duplex port. Regarding crc / input errors, is there any command i can use to check that on FreeBSD ?</div><div><br></div><div>Regards.</div><div>Shahzaib</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Jan 31, 2016 at 11:04 PM, Payam Chychi <span dir="ltr"><<a href="mailto:pchychi@gmail.com" target="_blank">pchychi@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>Hi,</div><div><br></div><div>Forget the application layer being the problem until you have successfully replicated the problem in several different setups.</div><div><br></div><div>Are you monitoring both links utilization levels? Really sounds like a network layer problem or something with your ip stack.</div><div><br></div><div>Can you replicate using ftp, scp?</div><div><br></div><div>How is your switch configured? How are the links negotiated, make sure both sides of both links are full duplex 1gig. Look for crc or input errors on the interface side.</div><div><br></div><div>How many packets are you pushing? Make sure the switch isnt activating unicast limiting.</div><div><br></div><div>Lots of things to check... Would help if you can help us understand what tests youve done to determine its nginx.</div><div><br></div><div>Thanks</div><span class="HOEnZb"><font color="#888888">
<div><div><br></div>-- <br>Payam Chychi<br>Network Engineer / Security Specialist<div><br></div></div></font></span><div class="HOEnZb"><div class="h5">
<p style="color:#a0a0a8">On Sunday, January 31, 2016 at 9:33 AM, Reinis Rozitis wrote:</p>
<blockquote type="cite" style="border-left-style:solid;border-width:1px;margin-left:0px;padding-left:10px">
<div><div><div>This is a bit out of scope of nginx but ..</div><div><br></div><blockquote type="cite"><div>could be network issue or LACP issue but doesn't looks like it is</div></blockquote><div><br></div><div>How did you determine this?</div><div>Can you generate more than 1 Gbps (without nginx)?</div><div><br></div><div><br></div><blockquote type="cite"><div><div>12 x 3TB SATA Raid-10 (HBA LSI-9211)</div><div>ZFS FileSystem with 18TB usable space</div></div></blockquote><div><br></div><blockquote type="cite"><div><div>Please i need guidance to handle with this problem, i am sure that some </div><div>value needs to tweak.</div></div></blockquote><div><br></div><div>What's the output of zpool iostat (and the overal zpool/zfs configuration)?</div><div><br></div><div>Also do you have ZFS on top of hardware raid ?</div><div><br></div><div>In general just 12 SATA disks won't have a lot of IOps (especially random </div><div>read) unless it all hits ZFS Arc (can/should be monitored), even more if </div><div>there is a hardware raid underneath (in your place would flash the HBA with </div><div>IT firmware so you get plain jbods managed by ZFS).</div><div><br></div><div>rr </div><div><br></div><div>_______________________________________________</div><div>nginx mailing list</div><div><a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a></div><div><a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/mailman/listinfo/nginx</a></div></div></div>
</blockquote>
<div>
<br>
</div>
</div></div><br>_______________________________________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" rel="noreferrer" target="_blank">http://mailman.nginx.org/mailman/listinfo/nginx</a><br></blockquote></div><br></div>