Centralized logging for multiple servers
dave at cheney.net
Wed Apr 15 18:06:55 MSD 2009
cat *.log | sort -k 4
On 15/04/2009, at 11:36 PM, Glen Lumanau wrote:
> Yes I already used it. But it seems taking too much resources
> Is there any other way that we can merge this logs?
> ------Original Message------
> From: Dave Cheney
> Sender: owner-nginx at sysoev.ru
> To: nginx at sysoev.ru
> ReplyTo: nginx at sysoev.ru
> Subject: Re: Centralized logging for multiple servers
> Sent: Apr 15, 2009 8:32 PM
> Awstats comes with a small perl file to merge multiple log files which
> I have used in the past
> On 15/04/2009, at 11:23 PM, Glen Lumanau wrote:
>> Then how can we join those logs that's sent to central host?
>> ------Original Message------
>> From: Igor Sysoev
>> Sender: owner-nginx at sysoev.ru
>> To: nginx at sysoev.ru
>> ReplyTo: nginx at sysoev.ru
>> Subject: Re: Centralized logging for multiple servers
>> Sent: Apr 15, 2009 8:12 PM
>> On Mon, Apr 13, 2009 at 12:56:29PM +0930, Kingsley Foreman wrote:
>>> Hi guys,
>>> Just wondering what you guys are using for centralized logging of
>>> logs for multiple servers. I'm thinking about using the syslog
>>> patch but I
>>> was wondering if anyone was using anything they think is better?
>>> And has
>>> piping of log files been implemented in the newer versions?
>> I personally do not like syslog and log piping.
>> I prefer to writing to local file system and to scp logs at midnight
>> central host.
>> Some time ago I needed to deliver logs for hourly statistics. I have
>> script that rotates log every hour, then gzips it (it takes several
>> seconds as a whole ~1G hourly log file is in VFS cache), and sends
>> the log to host. A daily log is done as
>> zcat hourly-logs.gz | 7z > daily-log.7z
>> and then it is copied to central host.
>> Igor Sysoev
>> Best Regards,
>> Glen Lumanau
>> Sent from my BlackBerry®
> Best Regards,
> Glen Lumanau
> Sent from my BlackBerry®
More information about the nginx