[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466229#comment-13466229
]
Hudson commented on MAPREDUCE-4689:
---
Integrated in Hadoop-Mapreduce-trunk #1211 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1211/])
MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE
(jlowe via bobby) (Revision 1391679)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1391679
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedTask.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Fix For: 3.0.0, 0.23.4, 2.0.3-alpha
>
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466212#comment-13466212
]
Hudson commented on MAPREDUCE-4689:
---
Integrated in Hadoop-Hdfs-trunk #1180 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1180/])
MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE
(jlowe via bobby) (Revision 1391679)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1391679
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedTask.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Fix For: 3.0.0, 0.23.4, 2.0.3-alpha
>
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13466203#comment-13466203
]
Hudson commented on MAPREDUCE-4689:
---
Integrated in Hadoop-Hdfs-0.23-Build #389 (See
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/389/])
svn merge -c 1391679 FIXES: MAPREDUCE-4689. JobClient.getMapTaskReports on
failed job results in NPE (jlowe via bobby) (Revision 1391681)
Result = UNSTABLE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1391681
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedTask.java
*
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Fix For: 3.0.0, 0.23.4, 2.0.3-alpha
>
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465963#comment-13465963
]
Hudson commented on MAPREDUCE-4689:
---
Integrated in Hadoop-Common-trunk-Commit #2786 (See
[https://builds.apache.org/job/Hadoop-Common-trunk-Commit/2786/])
MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE
(jlowe via bobby) (Revision 1391679)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1391679
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedTask.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465958#comment-13465958
]
Hudson commented on MAPREDUCE-4689:
---
Integrated in Hadoop-Mapreduce-trunk-Commit #2808 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2808/])
MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE
(jlowe via bobby) (Revision 1391679)
Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1391679
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedTask.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465956#comment-13465956
]
Hudson commented on MAPREDUCE-4689:
---
Integrated in Hadoop-Hdfs-trunk-Commit #2849 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/2849/])
MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE
(jlowe via bobby) (Revision 1391679)
Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1391679
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedTask.java
*
/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/java/org/apache/hadoop/mapreduce/v2/hs/TestJobHistoryParsing.java
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465935#comment-13465935
]
Robert Joseph Evans commented on MAPREDUCE-4689:
The patch looks OK to me +1. But this seems more like a band-aide than a full
solution. Shouldn't we be returning counters for the failed tasks too, just
like the AM does?
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465923#comment-13465923
]
Hadoop QA commented on MAPREDUCE-4689:
--
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12547047/MAPREDUCE-4689.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. The javadoc tool did not generate any
warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2891//testReport/
Console output:
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2891//console
This message is automatically generated.
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>Assignee: Jason Lowe
> Attachments: MAPREDUCE-4689.patch
>
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4689) JobClient.getMapTaskReports on failed job results in NPE
[
https://issues.apache.org/jira/browse/MAPREDUCE-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13464269#comment-13464269
]
Jason Lowe commented on MAPREDUCE-4689:
---
The call appears to be fine while the failing job is up and running, but once
it moves to the historyserver then it results in the NPE. Apparently the
historyserver is returning null for the task Counters when the task has failed,
and the client isn't prepared to handle that.
> JobClient.getMapTaskReports on failed job results in NPE
>
>
> Key: MAPREDUCE-4689
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4689
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: client
>Affects Versions: 0.23.3
>Reporter: Jason Lowe
>
> When calling JobClient.getMapTaskReports for a job that has failed results in
> an NPE. For example:
> {noformat}
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.hadoop.mapreduce.counters.AbstractCounters.(AbstractCounters.java:107)
> at org.apache.hadoop.mapred.Counters.(Counters.java:71)
> at org.apache.hadoop.mapred.Counters.downgrade(Counters.java:80)
> at org.apache.hadoop.mapred.TaskReport.downgrade(TaskReport.java:81)
> at
> org.apache.hadoop.mapred.TaskReport.downgradeArray(TaskReport.java:88)
> at org.apache.hadoop.mapred.JobClient.getTaskReports(JobClient.java:691)
> at
> org.apache.hadoop.mapred.JobClient.getMapTaskReports(JobClient.java:681)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
