Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Raditha Dissanayake
Hi, What kind of a log file are we talking here? regardless what processing you need to do generally working on a 1.2GB file with out RAID and/or lots of memory is going to be slow. Pablo Gosse wrote: Hi folks. Has anyone encountered any problems parsing large log files with PHP? I've got

RE: [PHP] Parsing large log files with PHP

2004-02-24 Thread Sam Masiello
Are you getting an error when trying to read/parse your log file? If so, what is that error? --Sam Pablo Gosse wrote: Hi folks. Has anyone encountered any problems parsing large log files with PHP? I've got a log file that's about 1.2 gig that I need to parse. Can PHP handle this or

RE: [PHP] Parsing large log files with PHP

2004-02-24 Thread Pablo Gosse
snip What kind of a log file are we talking here? regardless what processing you need to do generally working on a 1.2GB file with out RAID and/or lots of memory is going to be slow. Pablo Gosse wrote: Hi folks. Has anyone encountered any problems parsing large log files with PHP? I've got a

Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Raditha Dissanayake
Hi, IMHO bad idea to use a web script to process log files of these size (please ignore this comment if you are using the command line version). There are several good open source tools for parsing the apache log files (analog, webalizer, awstats to name a few). These are very fast and

Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Adam Bregenzer
On Tue, 2004-02-24 at 12:39, Pablo Gosse wrote: I've got a log file that's about 1.2 gig that I need to parse. Can PHP handle this or am I better of breaking this down into 12 100mb chunks and processing it? PHP has a very rich set of functions to read in files, it all depends on what you

RE: [PHP] Parsing large log files with PHP

2004-02-24 Thread Pablo Gosse
snip IMHO bad idea to use a web script to process log files of these size (please ignore this comment if you are using the command line version). /snip Yes, this will be a script run from the command line. snip There are several good open source tools for parsing the apache log files (analog,

Re: [PHP] Parsing large log files with PHP

2004-02-24 Thread Raditha Dissanayake
I'm not actually looking for stats in this case. We had a very strange occurrence yesterday wherein we had a few reports of porn links appearing on one of our websites. So basically I'm going to be looking for all log entries relating to that one specific section of our site (which won't be a