Re: YARN Logs

2014-07-16 Thread Brian C. Huffman
Vinod, When you say it's not easy, but possible, what would have to be done to make it work? Thanks, Brian On 07/15/2014 11:23 PM, Vinod Kumar Vavilapalli wrote: Adam is right. yarn logs command only works when log-aggregation is enabled. It's not easy but possible to make it work when

YARN Logs

2014-07-15 Thread Brian C. Huffman
All, I am running a small cluster with hadoop-2.2.0 installed on an NFS shared directory. Since all nodes can access, I do not want to enable log aggregation. My understanding was that if aggregation wasn't enabled, the 'yarn logs' command would just look in the $HADOOP_HOME/logs/userlogs

Re: YARN Logs

2014-07-15 Thread Adam Kawa
IMHO, $ yarn logs looks for aggregated logs at remote location. 2014-07-15 16:49 GMT+02:00 Brian C. Huffman bhuff...@etinternational.com: All, I am running a small cluster with hadoop-2.2.0 installed on an NFS shared directory. Since all nodes can access, I do not want to enable log

Re: YARN Logs

2014-07-15 Thread Adam Kawa
}/${username}/${yarn.nodemanager.remote-app-log-dir-suffix}/${application-id} 2014-07-15 18:08 GMT+02:00 Adam Kawa kawa.a...@gmail.com: IMHO, $ yarn logs looks for aggregated logs at remote location. 2014-07-15 16:49 GMT+02:00 Brian C. Huffman bhuff...@etinternational.com : All, I am running

Re: YARN Logs

2014-07-15 Thread Vinod Kumar Vavilapalli
Adam is right. yarn logs command only works when log-aggregation is enabled. It's not easy but possible to make it work when aggregation is disabled. +Vinod Hortonworks Inc. http://hortonworks.com/ On Tue, Jul 15, 2014 at 10:03 AM, Brian C. Huffman bhuff...@etinternational.com wrote