Comments on: Rotate Apache logs using Awstats

By: Felix

Felix — Thu, 10 Jun 2010 11:25:41 +0000

@Jay is there any chance you would share your script?
(I know its a bittle late)

Regards Felix

By: - Marius -

- Marius - — Wed, 26 Aug 2009 07:48:22 +0000

@iGuide: you define the log being parsed by awstats with the LogFile parameter inside the active configuration file.

By: iGuide

iGuide — Wed, 26 Aug 2009 04:46:25 +0000

Anyone have any idea which log files are being read by AwStats? I have so many in my /usr/local/apache/domlogs directory, the largest of which are about 100M for 12 hours of logging. So does that mean AwStats is deleting log files every 12 hours?

By: facebook et cnil, log rotate et backlinks yahoo

facebook et cnil, log rotate et backlinks yahoo — Fri, 10 Apr 2009 19:53:42 +0000

[...] Rotate Apache logs using Awstats | MDLog:/sysadmin [...]

By: Jay Fougere

Jay Fougere — Wed, 18 Jun 2008 15:26:13 +0000

@Erik: I don’t know of any tools that query the database directly, however the fields in the table are the same fields that you would see in the apache logs.

What I have been doing is running a perl script I wrote on a cron that does several things. First, it dumps the contents of the database into a temporary file that is in the apache log format. It then calls awstats which is set up to use that file as its log file. Lastly, it records in another table the timestamp of the last record it looked at. This way, it knows where to begin the log the next time around.

By: Erik

Erik — Tue, 17 Jun 2008 14:21:08 +0000

@Jay: do you know any tools, that analyses such logs which was wrote to a mysql db??

By: Jay Fougere

Jay Fougere — Wed, 11 Jun 2008 21:35:43 +0000

I have found that mod_log_sql is my answer to apache log manipulation. Basically it simply writes your apache logs to a MySQL database rather than a flat file.

Not only can you avoid gaps in your stats you can log to the same table from multiple web servers. This allows for sites that are run on multiple web servers to have aggregated stats or the ability to aggregate stats across all sites that you are responsible for (network-wide stats).

A simple perl script can create a temporary logfile from the database to run your stats program against and a tiny table can be used to track the time stamp of where you left off.

I have been doing this with great success for over 1000 sites that I manage.