[jira] [Resolved] (MAPREDUCE-4891) Pluggable merge at reduce side

[ https://issues.apache.org/jira/browse/MAPREDUCE-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4891. -- Resolution: Duplicate Duplicate of MAPREDUCE-4808 > Pluggable merg

[jira] [Commented] (MAPREDUCE-4883) Reducer's Maximum Shuffle Buffer Size should be enlarged for 64bit JVM

[ https://issues.apache.org/jira/browse/MAPREDUCE-4883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535703#comment-13535703 ] Arun C Murthy commented on MAPREDUCE-4883: -- http://s.apache.org/5Ur It's an

[jira] [Updated] (MAPREDUCE-4067) Replace YarnRemoteException with IOException in MRv2 APIs

[ https://issues.apache.org/jira/browse/MAPREDUCE-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4067: - Assignee: Xuan Gong (was: Siddharth Seth) > Replace YarnRemoteException with IOE

[jira] [Commented] (MAPREDUCE-4891) Pluggable merge at reduce side

[ https://issues.apache.org/jira/browse/MAPREDUCE-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535618#comment-13535618 ] Alejandro Abdelnur commented on MAPREDUCE-4891: --- Jerry, unless I'm missi

[jira] [Created] (MAPREDUCE-4891) Pluggable merge at reduce side

Jerry Chen created MAPREDUCE-4891: - Summary: Pluggable merge at reduce side Key: MAPREDUCE-4891 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4891 Project: Hadoop Map/Reduce Issue Type

[jira] [Commented] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535606#comment-13535606 ] Hadoop QA commented on MAPREDUCE-4887: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4890) Invalid TaskImpl state transitions when task fails while speculating

[ https://issues.apache.org/jira/browse/MAPREDUCE-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535605#comment-13535605 ] Jason Lowe commented on MAPREDUCE-4890: --- Note that it appears the task KILLED st

[jira] [Commented] (MAPREDUCE-4890) Invalid TaskImpl state transitions when task fails while speculating

[ https://issues.apache.org/jira/browse/MAPREDUCE-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535603#comment-13535603 ] Jason Lowe commented on MAPREDUCE-4890: --- Example exception trace when a speculat

[jira] [Created] (MAPREDUCE-4890) Invalid TaskImpl state transitions when task fails while speculating

Jason Lowe created MAPREDUCE-4890: - Summary: Invalid TaskImpl state transitions when task fails while speculating Key: MAPREDUCE-4890 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4890 Project:

[jira] [Updated] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4887: --- Status: Patch Available (was: Open) > Rehashing partitioner for better distribution

[jira] [Updated] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4887: --- Attachment: rehash4.txt unit test added - test if hash function returns smooth distributi

[jira] [Commented] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535588#comment-13535588 ] Radim Kolar commented on MAPREDUCE-4887: Very smooth distribution for pattern.

[jira] [Commented] (MAPREDUCE-2454) Allow external sorter plugin for MR

[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535586#comment-13535586 ] Jerry Chen commented on MAPREDUCE-2454: --- Hi Asokan, Thank you for your work on t

[jira] [Created] (MAPREDUCE-4889) AM should have a diagnostics message for invalid state transitions

Jason Lowe created MAPREDUCE-4889: - Summary: AM should have a diagnostics message for invalid state transitions Key: MAPREDUCE-4889 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4889 Project: H

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535507#comment-13535507 ] Hadoop QA commented on MAPREDUCE-4594: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4594: --- Attachment: partitioner8.txt > Add init/shutdown methods to mapreduce Partitioner > -

[jira] [Commented] (MAPREDUCE-4833) Task can get stuck in FAIL_CONTAINER_CLEANUP

[ https://issues.apache.org/jira/browse/MAPREDUCE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535323#comment-13535323 ] Hadoop QA commented on MAPREDUCE-4833: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-4833) Task can get stuck in FAIL_CONTAINER_CLEANUP

[ https://issues.apache.org/jira/browse/MAPREDUCE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535288#comment-13535288 ] Robert Parker commented on MAPREDUCE-4833: -- Previously the Container did not

[jira] [Updated] (MAPREDUCE-4833) Task can get stuck in FAIL_CONTAINER_CLEANUP

[ https://issues.apache.org/jira/browse/MAPREDUCE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-4833: - Release Note: (was: Previously the Container did not send an event on kill if it wa

[jira] [Updated] (MAPREDUCE-4833) Task can get stuck in FAIL_CONTAINER_CLEANUP

[ https://issues.apache.org/jira/browse/MAPREDUCE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-4833: - Attachment: MAPREDUCE4833-23.patch > Task can get stuck in FAIL_CONTAINER_CLEANUP

[jira] [Updated] (MAPREDUCE-4833) Task can get stuck in FAIL_CONTAINER_CLEANUP

[ https://issues.apache.org/jira/browse/MAPREDUCE-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Parker updated MAPREDUCE-4833: - Release Note: Previously the Container did not send an event on kill if it was DONE,

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535280#comment-13535280 ] Hadoop QA commented on MAPREDUCE-4594: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4842: Attachment: mapreduce-4842.patch I updated patch. All the changes are in {{Mer

[jira] [Updated] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4594: --- Attachment: partitioner7.txt patch reuploaded > Add init/shutdown method

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535241#comment-13535241 ] Hadoop QA commented on MAPREDUCE-4594: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4887: --- Attachment: rehash3.txt fixed javadoc comment. > Rehashing partitioner f

[jira] [Commented] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535214#comment-13535214 ] Hadoop QA commented on MAPREDUCE-4839: -- {color:green}+1 overall{color}. Here are

[jira] [Updated] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4594: --- Attachment: partitioner6.txt > Add init/shutdown methods to mapreduce Partitioner > -

[jira] [Updated] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4839: --- Attachment: textpartitioner4.txt > TextPartioner for hashing Text with good hashing f

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535148#comment-13535148 ] Hadoop QA commented on MAPREDUCE-4594: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4594: --- Attachment: partitioner6.txt > Add init/shutdown methods to mapreduce Partitioner > -

[jira] [Commented] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535133#comment-13535133 ] Hadoop QA commented on MAPREDUCE-4808: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535122#comment-13535122 ] Hadoop QA commented on MAPREDUCE-4594: -- {color:red}-1 overall{color}. Here are t

[jira] [Updated] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar updated MAPREDUCE-4594: --- Attachment: partitioner5.txt > Add init/shutdown methods to mapreduce Partitioner > -

[jira] [Updated] (MAPREDUCE-4808) Allow reduce-side merge to be pluggable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mariappan Asokan updated MAPREDUCE-4808: Attachment: mapreduce-4808.patch Fixed java compiler warnings in the tests.

[jira] [Commented] (MAPREDUCE-4842) Shuffle race can hang reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535094#comment-13535094 ] Mariappan Asokan commented on MAPREDUCE-4842: - Hi Jason, Thomas, and Siddh

[jira] [Commented] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535089#comment-13535089 ] Radim Kolar commented on MAPREDUCE-4887: HashPartitioner do not have unit test

[jira] [Updated] (MAPREDUCE-4887) Rehashing partitioner for better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated MAPREDUCE-4887: Status: Open (was: Patch Available) This patch needs some unit tests.

[jira] [Commented] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13535038#comment-13535038 ] Robert Joseph Evans commented on MAPREDUCE-4888: I really don't have t

[jira] [Updated] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4888: --- Attachment: test.patch This patch exposes the issue. It is mostly just a

[jira] [Updated] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated MAPREDUCE-4888: --- Summary: NLineInputFormat drops data in 1.1 and beyond (was: NLineInputF

[jira] [Created] (MAPREDUCE-4888) NLineInputFormat dropps data in 1.1 and beyond

Robert Joseph Evans created MAPREDUCE-4888: -- Summary: NLineInputFormat dropps data in 1.1 and beyond Key: MAPREDUCE-4888 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4888 Project: Hado

[jira] [Commented] (MAPREDUCE-4845) ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2

[ https://issues.apache.org/jira/browse/MAPREDUCE-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534972#comment-13534972 ] Hudson commented on MAPREDUCE-4845: --- Integrated in Hadoop-trunk-Commit #3136 (See [

[jira] [Updated] (MAPREDUCE-4845) ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2

[ https://issues.apache.org/jira/browse/MAPREDUCE-4845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-4845: - Resolution: Fixed Fix Version/s: 2.0.3-alpha 1.2.0 Hadoop Flags

[jira] [Commented] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534965#comment-13534965 ] Robert Joseph Evans commented on MAPREDUCE-4839: I have not really loo

[jira] [Updated] (MAPREDUCE-4824) Provide a mechanism for jobs to indicate they should not be recovered on restart

[ https://issues.apache.org/jira/browse/MAPREDUCE-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White updated MAPREDUCE-4824: - Attachment: MAPREDUCE-4824.patch Updated with latest branch. > Provide a mec

[jira] [Commented] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534881#comment-13534881 ] Radim Kolar commented on MAPREDUCE-4839: it can not be tested that way without

[jira] [Updated] (MAPREDUCE-4703) Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped.

[ https://issues.apache.org/jira/browse/MAPREDUCE-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated MAPREDUCE-4703: -- Resolution: Fixed Fix Version/s: 1.2.0 Hadoop Flags: Reviewed

[jira] [Commented] (MAPREDUCE-4703) Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped.

[ https://issues.apache.org/jira/browse/MAPREDUCE-4703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534879#comment-13534879 ] Alejandro Abdelnur commented on MAPREDUCE-4703: --- +1 > A

[jira] [Commented] (MAPREDUCE-4762) repair test org.apache.hadoop.mapreduce.security.token.TestDelegationTokenRenewal

[ https://issues.apache.org/jira/browse/MAPREDUCE-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534843#comment-13534843 ] Ivan A. Veselovsky commented on MAPREDUCE-4762: --- The class DelegationTok

[jira] [Commented] (MAPREDUCE-4839) TextPartioner for hashing Text with good hashing function to get better distribution

[ https://issues.apache.org/jira/browse/MAPREDUCE-4839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534829#comment-13534829 ] Luke Lu commented on MAPREDUCE-4839: Don't you think that the test should verify t

[jira] [Commented] (MAPREDUCE-4594) Add init/shutdown methods to mapreduce Partitioner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13534828#comment-13534828 ] Luke Lu commented on MAPREDUCE-4594: # Fix test name and comments. It's neither Te