Access YARN container's log directory from map reduce

2016-11-28 Thread Eqbal
Hi, I would like to be able to access yarn container's log directory from my map reduce implementation. For example if I have the following config yarn.nodemanager.log-dirs=/mnt/yarn/log I want to access the subfolder for the container log that's written to this directory e.g., /mnt/yarn/log/a

Re: Issues with getting HTrace to work with Hadoop 2.7.3

2016-11-28 Thread Masatake Iwasaki
Hi Alexandru, Thanks for trying out HTrace and reporting this. The tracing documentation of 2.7.3 seems to be outdated. > In 2.6.0 I'd have this line in the namenode log file : > > INFO org.apache.hadoop.tracing.SpanReceiverHost: SpanReceiver > org.htrace.impl.ZipkinSpanReceiver was loaded succ