Re: Logging from the job
Ok, thanks. Unfortunately ant is currently not installed on machine running hadoop. What if I use slf4j + logback just in job's jar? BTW, is hadoop planning to migrate on this stack from the deprecated Apache commons and log4j? On Tue, 2010-04-27 at 10:57 +0100, Steve Loughran wrote: > Jeff Zhang wrote: > > you should use the log4j rather than the apache common logging > > > > Not necessarily. Hadoop code uses commons logging which defaults to going > to log4j, but lets you plug in different back ends via JVM properties. > This lets you do some tricks with log aggregation. > > If changes to log4.properties don't seem to get picked up, it could be > some JAR has a copy of the file which is getting in the way. You can use > Ant's task to maybe track this down. > > classpathref="some classpath reference">
Re: Logging from the job
I'm expecting to see the logs on the console since the root logger is configured to do so. On Tue, 2010-04-27 at 14:28 +0530, Amareshwari Sri Ramadasu wrote: > Where are you looking for the logs? > They will be available in Tasklogs. You can view them from web ui from > taskdetails.jsp page. > > -Amareshwari > > On 4/27/10 2:22 PM, "Alexander Semenov" wrote: > > Hi all. > > I'm not sure if I'm posting to correct mail list, please, suggest the > correct one if so. > > I need to log statements from the running job, e.g. use Apache commons > logging to print debug messages on map and reduce operations. I've tuned > the conf/log4.properties file for my logging domain but log statements > are still missing in the log files and on the console. I start the job > like this: > > hadoop jar jar_file.jar input_dir output_dir > > The job finishes gracefully but I see no logging. > > Any suggestions? > Thanks. > >
Logging from the job
Hi all. I'm not sure if I'm posting to correct mail list, please, suggest the correct one if so. I need to log statements from the running job, e.g. use Apache commons logging to print debug messages on map and reduce operations. I've tuned the conf/log4.properties file for my logging domain but log statements are still missing in the log files and on the console. I start the job like this: hadoop jar jar_file.jar input_dir output_dir The job finishes gracefully but I see no logging. Any suggestions? Thanks.
