<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Not sure what you mean about sFlow needing to be open source? Here are links to the relevant open-source projects:<div><br></div><div><a href="http://nginx-sflow-module.googlecode.com">http://nginx-sflow-module.googlecode.com</a></div><div><a href="http://host-sflow.sourceforge.net">http://host-sflow.sourceforge.net</a></div><div><a href="http://www.inmon.com/technology/sflowTools.php">http://www.inmon.com/technology/sflowTools.php</a></div><div><br></div><div>With a more complete "developer resources" description here:</div><div><a href="http://blog.sflow.com/2010/01/developer-resources.html">http://blog.sflow.com/2010/01/developer-resources.html</a></div><div><br></div><div>If you use sflowtool to turn sFlow-HTTP into common-log format at the collector, that opens up a whole ecosystem of open-source perl/python/bash/PHP tools for the analysis, such as AWStats.</div><div><a href="http://awstats.sourceforge.net/">http://awstats.sourceforge.net/</a></div><div><br></div><div>The sFlow-HTTP feed also sends performance counters every N seconds. I don't yet know of an open-source adaptor to feed that into something like Nagios, Ganglia or Graphite, but I know there are options to do that with the sFlow-HOST performance counters so it shouldn't be hard to add. In fact, Ganglia now has native support for the sFlow-HOST counters. </div><div> <a href="http://ganglia.info/?p=430">http://ganglia.info/?p=430</a></div><div><br></div><div>This sFlow-HOST (<a href="http://host-sflow.sourceforge.net">http://host-sflow.sourceforge.net</a>) part is helpful because it provides telemetry on the underlying CPU/mem/disk/network stats in a light and scalable way, and supports zero-config (DNS-SD) to make sFlow easier to roll out on a large cluster/farm.</div><div><br></div><div>Neil</div><div><br></div><div><br><div><div>On Aug 1, 2011, at 6:09 PM, SplitIce wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">sflow would be great it it was open source and had an easily customizable server (perl/python/bash or PHP)<br><br><div class="gmail_quote">On Tue, Aug 2, 2011 at 5:08 AM, Harold Sinclair <span dir="ltr"><<a href="mailto:haroldsinclair@gmail.com">haroldsinclair@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">I cobbled something like this together with open source tools and have been using it on hundreds of servers.. pls contact me offline if you'd like a copy :)<br>
<font color="#888888"><br>-Harold</font><div><div></div><div class="h5"><br><br><div class="gmail_quote">On Mon, Aug 1, 2011 at 2:57 PM, Dennis Jacobfeuerborn <span dir="ltr"><<a href="mailto:dennisml@conversis.de" target="_blank">dennisml@conversis.de</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204, 204, 204);padding-left:1ex">An alternative is to tail -F (aka. "--follow=name --retry") the log file and pipe the output into a script. This allows you to parse the entries as they come in and rotate the log file as often as you want independently of the parsing script.<br>
<br>
Regards,<br>
Dennis<br>
<br>
On 08/01/2011 04:57 PM, Randy Parker wrote:<br>
<blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204, 204, 204);padding-left:1ex">
My app has a request that opens the log file, fseeks to the end, backs up<br>
as many bytes as it takes to get to the size the log file was on the last<br>
similar request by that user, and runs a regex over the novel part to get<br>
interesting metrics before closing the file. Since this happens less than<br>
once per minute, I have not done anything fancy to optimize.<br>
<br>
- Randy<br>
<br>
On Mon, Aug 1, 2011 at 10:39 AM, Reinis Rozitis <<a href="mailto:r@roze.lv" target="_blank">r@roze.lv</a><br>
<mailto:<a href="mailto:r@roze.lv" target="_blank">r@roze.lv</a>>> wrote:<br>
<br>
I'm looking for a near real-time script to parse log files and<br>
insert interesting data into a db.<br>
Does anyone know of an existing script to do this?<br>
<br>
<br>
You can check/try <a href="http://www.splunk.com/" target="_blank">http://www.splunk.com</a><br>
<br>
rr<br>
<br>
<br>
______________________________<u></u>___________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a> <mailto:<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a>><br>
<a href="http://mailman.nginx.org/__mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/__<u></u>mailman/listinfo/nginx</a><br>
<<a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/<u></u>mailman/listinfo/nginx</a>><br>
<br>
<br>
<br>
<br>
--<br>
<a href="http://mobiledyne.com/" target="_blank">http://mobiledyne.com</a><br>
<br>
<br>
______________________________<u></u>_________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/<u></u>mailman/listinfo/nginx</a><br>
</blockquote>
<br>
______________________________<u></u>_________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org" target="_blank">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/<u></u>mailman/listinfo/nginx</a><br>
</blockquote></div><br>
</div></div><br>_______________________________________________<br>
nginx mailing list<br>
<a href="mailto:nginx@nginx.org">nginx@nginx.org</a><br>
<a href="http://mailman.nginx.org/mailman/listinfo/nginx" target="_blank">http://mailman.nginx.org/mailman/listinfo/nginx</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><a href="http://thewarezscene.org/" target="_blank">Warez Scene</a> <a href="http://www.nexusddl.com/" target="_blank">Free Rapidshare Downloads</a><br><br>
_______________________________________________<br>nginx mailing list<br><a href="mailto:nginx@nginx.org">nginx@nginx.org</a><br><a href="http://mailman.nginx.org/mailman/listinfo/nginx">http://mailman.nginx.org/mailman/listinfo/nginx</a><br></blockquote></div><br></div></body></html>