Re: Logging from the job

2010-04-27 Thread Alex Kozlov
Hi Alexander, Where are you looking for the logs? The output of the tasks should be in $HADOOP_LOG_DIR/userlogs/attempt*/{stdout,stderr,syslog}. Could you provide the exact java command line your tasks are running with (do 'ps -ef | grep Child' on one of the nodes when the job is running). Alex

Re: Logging from the job

2010-04-27 Thread Steve Loughran
Alexander Semenov wrote: Ok, thanks. Unfortunately ant is currently not installed on machine running hadoop. What if I use slf4j + logback just in job's jar? depends on the classpath. You can do it in your own code by getting whatever classloader you use then call getResource("log4.properties"

Re: Logging from the job

2010-04-27 Thread Alexander Semenov
Ok, thanks. Unfortunately ant is currently not installed on machine running hadoop. What if I use slf4j + logback just in job's jar? BTW, is hadoop planning to migrate on this stack from the deprecated Apache commons and log4j? On Tue, 2010-04-27 at 10:57 +0100, Steve Loughran wrote: > Jeff Zhang

Re: Logging from the job

2010-04-27 Thread Alexander Semenov
I'm expecting to see the logs on the console since the root logger is configured to do so. On Tue, 2010-04-27 at 14:28 +0530, Amareshwari Sri Ramadasu wrote: > Where are you looking for the logs? > They will be available in Tasklogs. You can view them from web ui from > taskdetails.jsp page. > >

Re: Logging from the job

2010-04-27 Thread Steve Loughran
Jeff Zhang wrote: you should use the log4j rather than the apache common logging Not necessarily. Hadoop code uses commons logging which defaults to going to log4j, but lets you plug in different back ends via JVM properties. This lets you do some tricks with log aggregation. If changes to

Re: Logging from the job

2010-04-27 Thread Jeff Zhang
you should use the log4j rather than the apache common logging On Tue, Apr 27, 2010 at 4:52 PM, Alexander Semenov wrote: > Hi all. > > I'm not sure if I'm posting to correct mail list, please, suggest the > correct one if so. > > I need to log statements from the running job, e.g. use Apache comm

Re: Logging from the job

2010-04-27 Thread Amareshwari Sri Ramadasu
Where are you looking for the logs? They will be available in Tasklogs. You can view them from web ui from taskdetails.jsp page. -Amareshwari On 4/27/10 2:22 PM, "Alexander Semenov" wrote: Hi all. I'm not sure if I'm posting to correct mail list, please, suggest the correct one if so. I need

Logging from the job

2010-04-27 Thread Alexander Semenov
Hi all. I'm not sure if I'm posting to correct mail list, please, suggest the correct one if so. I need to log statements from the running job, e.g. use Apache commons logging to print debug messages on map and reduce operations. I've tuned the conf/log4.properties file for my logging domain but