saving log file

[AJ Chen]

Following the tutorial, I redirect the log messages to a log file. But, 
when crawling 1 million pages, this log file can become hugh and writing 
log messages to a huge file can slow down the fetching process.  Is 
there a better way to manage the log?  maybe saving it to a series of 
smaller files? appreciate your suggestions.
-AJ