trying to tune kafka's internal logging - need help...

2014-08-06 Thread Shlomi Hazan
Hi,

I am trying to get rid of the log files written under “$base_dir/logs”,
folder create by line 26 at “bin/kafka-run-class.sh”.

I use an EC2 machine with small primary disk and it blows away on occasions
when writing to these logs is excessive, and I bumped into a few already
(from Jira it looks like you guys know about them).

Tried to export “LOG_DIR”, “KAFKA_LOG4J_OPTS”, No luck till now…. L

What log4j properties file should be put where to squelch that logging? Is
there any such file?



P.S.

Saw that SCALA_VERSION defaults to 2.8.0 even in the other scala versions
distributables.

Should I set to 2.9.2/2.10/etc?

Are there any other vars to take in account?



10x,

Shlomi


Re: trying to tune kafka's internal logging - need help...

2014-08-06 Thread Harsha
Hi Sholmi,
  kafka-run-class.sh uses config/tools-log4.properties. The
  config it has writes to console 
log4j.appender.stdout=org.apache.log4j.ConsoleAppender

If you want to save the log output from kafka-run-class change the above
appender to use DailyRollingFileAppender. for ex
log4j.appender.kafkaAppender=org.apache.log4j.DailyRollingFileAppender
log4j.appender.kafkaAppender.DatePattern='.'-MM-dd-HH
log4j.appender.kafkaAppender.File=${kafka.logs.dir}/kafka-tools.log

and export LOG_DIR as you did before. 
-Harsha

On Wed, Aug 6, 2014, at 09:43 AM, Shlomi Hazan wrote:
 Hi,
 
 I am trying to get rid of the log files written under “$base_dir/logs”,
 folder create by line 26 at “bin/kafka-run-class.sh”.
 
 I use an EC2 machine with small primary disk and it blows away on
 occasions
 when writing to these logs is excessive, and I bumped into a few already
 (from Jira it looks like you guys know about them).
 
 Tried to export “LOG_DIR”, “KAFKA_LOG4J_OPTS”, No luck till now…. L
 
 What log4j properties file should be put where to squelch that logging?
 Is
 there any such file?
 
 
 
 P.S.
 
 Saw that SCALA_VERSION defaults to 2.8.0 even in the other scala versions
 distributables.
 
 Should I set to 2.9.2/2.10/etc?
 
 Are there any other vars to take in account?
 
 
 
 10x,
 
 Shlomi