RE: YARN log access
Thanks, I missed the target 2.4.0 release. For 2.2.0, is there any way to reach the individual task container logs? John From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Saturday, January 04, 2014 10:47 AM To: common-u...@hadoop.apache.org Subject: Re: YARN log access YARN-649 is targeted at 2.4.0 release and YARN-1524 is Open. From the link you posted, I see: amContainerLogs The URL of the application master container logs On Sat, Jan 4, 2014 at 9:18 AM, John Lilley john.lil...@redpoint.netmailto:john.lil...@redpoint.net wrote: Ted, Thanks for the pointer. But when I read about the RESTful API: http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Application_API I only see a method to query the AM logs, not the task container logs. How does one get from AppID to the list of task container logs? Thanks john From: Ted Yu [mailto:yuzhih...@gmail.commailto:yuzhih...@gmail.com] See: https://issues.apache.org/jira/browse/YARN-649 https://issues.apache.org/jira/browse/YARN-1524 On Fri, Jan 3, 2014 at 8:50 AM, John Lilley john.lil...@redpoint.netmailto:john.lil...@redpoint.net wrote: Is there a programmatic or HTTP interface for querying the logs of a YARN application run? Ideally I would start with the AppID, query the AppMaster log, and then descend into the task logs.
Re: YARN log access
There is another thread on 2.2 patch release: http://search-hadoop.com/m/xHm23dcjsT/2.2+patch+releasesubj=Re+Will+there+be+a+2+2+patch+releases+ Why not voice your opinion there ? Cheers On Sun, Jan 5, 2014 at 1:24 PM, John Lilley john.lil...@redpoint.netwrote: Thanks, I missed the target 2.4.0 release. For 2.2.0, is there any way to reach the individual task container logs? John *From:* Ted Yu [mailto:yuzhih...@gmail.com] *Sent:* Saturday, January 04, 2014 10:47 AM *To:* common-u...@hadoop.apache.org *Subject:* Re: YARN log access YARN-649 is targeted at 2.4.0 release and YARN-1524 is Open. From the link you posted, I see: amContainerLogs The URL of the application master container logs On Sat, Jan 4, 2014 at 9:18 AM, John Lilley john.lil...@redpoint.net wrote: Ted, Thanks for the pointer. But when I read about the RESTful API: http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Application_API I only see a method to query the AM logs, not the task container logs. How does one get from AppID to the list of task container logs? Thanks john From: Ted Yu [mailto:yuzhih...@gmail.com] See: https://issues.apache.org/jira/browse/YARN-649 https://issues.apache.org/jira/browse/YARN-1524 On Fri, Jan 3, 2014 at 8:50 AM, John Lilley john.lil...@redpoint.net wrote: Is there a programmatic or HTTP interface for querying the logs of a YARN application run? Ideally I would start with the AppID, query the AppMaster log, and then descend into the task logs.
RE: YARN log access
Ted, Thanks for the pointer. But when I read about the RESTful API: http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Application_API I only see a method to query the AM logs, not the task container logs. How does one get from AppID to the list of task container logs? Thanks john From: Ted Yu [mailto:yuzhih...@gmail.com] See: https://issues.apache.org/jira/browse/YARN-649 https://issues.apache.org/jira/browse/YARN-1524 On Fri, Jan 3, 2014 at 8:50 AM, John Lilley john.lil...@redpoint.net wrote: Is there a programmatic or HTTP interface for querying the logs of a YARN application run? Ideally I would start with the AppID, query the AppMaster log, and then descend into the task logs.
