[jira] [Updated] (MAPREDUCE-4464) Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
[
https://issues.apache.org/jira/browse/MAPREDUCE-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated MAPREDUCE-4464:
---
Attachment: MAPREDUCE-4464.patch
I improved the message in Clint's patch a slight bit to indicate what to look
at.
And I could also successfully reproduce the issue on a forced bad hostname
machine (devel_vm.vm):
{code}
12/09/27 21:52:16 INFO mapred.JobClient: Task Id :
attempt_201209272149_0001_r_00_2, Status : FAILED
Error: java.io.IOException: Invalid hostname found in tracker location:
'http://devel_vm.vm:50060'
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.getMapCompletionEvents(ReduceTask.java:2920)
at
org.apache.hadoop.mapred.ReduceTask$ReduceCopier$GetMapEventsThread.run(ReduceTask.java:2845)
{code}
Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
-
Key: MAPREDUCE-4464
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4464
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Affects Versions: 1.0.0
Reporter: Clint Heath
Assignee: Clint Heath
Priority: Minor
Attachments: MAPREDUCE-4464_new.patch, MAPREDUCE-4464.patch,
MAPREDUCE-4464.patch
Original Estimate: 1h
Remaining Estimate: 1h
If DNS does not resolve hostnames properly, reduce tasks can fail with a very
misleading exception.
as per my peer Ahmed's diagnosis:
In ReduceTask, it seems that event.getTaskTrackerHttp() returns a malformed
URI, and so host from:
{code}
String host = u.getHost();
{code}
is evaluated to null and the NullPointerException is thrown afterwards in the
ConcurrentHashMap.
I have written a patch to check for a null hostname condition when getHost is
called in the getMapCompletionEvents method and print an intelligible warning
message rather than suppressing it until later when it becomes confusing and
misleading.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4464) Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
[
https://issues.apache.org/jira/browse/MAPREDUCE-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated MAPREDUCE-4464:
---
Issue Type: Improvement (was: Bug)
Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
-
Key: MAPREDUCE-4464
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4464
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: task
Affects Versions: 1.0.0
Reporter: Clint Heath
Assignee: Clint Heath
Priority: Minor
Fix For: 1.2.0
Attachments: MAPREDUCE-4464_new.patch, MAPREDUCE-4464.patch,
MAPREDUCE-4464.patch
Original Estimate: 1h
Remaining Estimate: 1h
If DNS does not resolve hostnames properly, reduce tasks can fail with a very
misleading exception.
as per my peer Ahmed's diagnosis:
In ReduceTask, it seems that event.getTaskTrackerHttp() returns a malformed
URI, and so host from:
{code}
String host = u.getHost();
{code}
is evaluated to null and the NullPointerException is thrown afterwards in the
ConcurrentHashMap.
I have written a patch to check for a null hostname condition when getHost is
called in the getMapCompletionEvents method and print an intelligible warning
message rather than suppressing it until later when it becomes confusing and
misleading.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4464) Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
[
https://issues.apache.org/jira/browse/MAPREDUCE-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harsh J updated MAPREDUCE-4464:
---
Resolution: Fixed
Fix Version/s: 1.2.0
Status: Resolved (was: Patch Available)
I've committed this to branch-1. Thanks very much for the report, your keen eye
for issues, and your patch contributions Clint! Hope to see more in future!
Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
-
Key: MAPREDUCE-4464
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4464
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: task
Affects Versions: 1.0.0
Reporter: Clint Heath
Assignee: Clint Heath
Priority: Minor
Fix For: 1.2.0
Attachments: MAPREDUCE-4464_new.patch, MAPREDUCE-4464.patch,
MAPREDUCE-4464.patch
Original Estimate: 1h
Remaining Estimate: 1h
If DNS does not resolve hostnames properly, reduce tasks can fail with a very
misleading exception.
as per my peer Ahmed's diagnosis:
In ReduceTask, it seems that event.getTaskTrackerHttp() returns a malformed
URI, and so host from:
{code}
String host = u.getHost();
{code}
is evaluated to null and the NullPointerException is thrown afterwards in the
ConcurrentHashMap.
I have written a patch to check for a null hostname condition when getHost is
called in the getMapCompletionEvents method and print an intelligible warning
message rather than suppressing it until later when it becomes confusing and
misleading.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4464) Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
[
https://issues.apache.org/jira/browse/MAPREDUCE-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Clint Heath updated MAPREDUCE-4464:
---
Hadoop Flags: Reviewed
Status: Patch Available (was: Open)
Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
-
Key: MAPREDUCE-4464
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4464
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Affects Versions: 1.0.0
Reporter: Clint Heath
Assignee: Clint Heath
Priority: Minor
Attachments: MAPREDUCE-4464_new.patch, MAPREDUCE-4464.patch
Original Estimate: 1h
Remaining Estimate: 1h
If DNS does not resolve hostnames properly, reduce tasks can fail with a very
misleading exception.
as per my peer Ahmed's diagnosis:
In ReduceTask, it seems that event.getTaskTrackerHttp() returns a malformed
URI, and so host from:
{code}
String host = u.getHost();
{code}
is evaluated to null and the NullPointerException is thrown afterwards in the
ConcurrentHashMap.
I have written a patch to check for a null hostname condition when getHost is
called in the getMapCompletionEvents method and print an intelligible warning
message rather than suppressing it until later when it becomes confusing and
misleading.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4464) Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
[
https://issues.apache.org/jira/browse/MAPREDUCE-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Clint Heath updated MAPREDUCE-4464:
---
Attachment: MAPREDUCE-4464_new.patch
I have just attached the new patch which throws an IO Exception instead. Would
it be possible to request that this JIRA be assigned to me? I'd like to get
this resolved as quickly as possible. Thank you.
Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
-
Key: MAPREDUCE-4464
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4464
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Affects Versions: 1.0.0
Reporter: Clint Heath
Priority: Minor
Attachments: MAPREDUCE-4464.patch, MAPREDUCE-4464_new.patch
Original Estimate: 1h
Remaining Estimate: 1h
If DNS does not resolve hostnames properly, reduce tasks can fail with a very
misleading exception.
as per my peer Ahmed's diagnosis:
In ReduceTask, it seems that event.getTaskTrackerHttp() returns a malformed
URI, and so host from:
{code}
String host = u.getHost();
{code}
is evaluated to null and the NullPointerException is thrown afterwards in the
ConcurrentHashMap.
I have written a patch to check for a null hostname condition when getHost is
called in the getMapCompletionEvents method and print an intelligible warning
message rather than suppressing it until later when it becomes confusing and
misleading.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4464) Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
[
https://issues.apache.org/jira/browse/MAPREDUCE-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Clint Heath updated MAPREDUCE-4464:
---
Attachment: MAPREDUCE-4464.patch
Reduce tasks failing with NullPointerException in ConcurrentHashMap.get()
-
Key: MAPREDUCE-4464
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4464
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: task
Affects Versions: 1.0.0
Reporter: Clint Heath
Priority: Minor
Attachments: MAPREDUCE-4464.patch
Original Estimate: 1h
Remaining Estimate: 1h
If DNS does not resolve hostnames properly, reduce tasks can fail with a very
misleading exception.
as per my peer Ahmed's diagnosis:
In ReduceTask, it seems that event.getTaskTrackerHttp() returns a malformed
URI, and so host from:
{code}
String host = u.getHost();
{code}
is evaluated to null and the NullPointerException is thrown afterwards in the
ConcurrentHashMap.
I have written a patch to check for a null hostname condition when getHost is
called in the getMapCompletionEvents method and print an intelligible warning
message rather than suppressing it until later when it becomes confusing and
misleading.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
