[jira] [Updated] (MAPREDUCE-7159) FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

[ https://issues.apache.org/jira/browse/MAPREDUCE-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7159: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.1

[jira] [Commented] (MAPREDUCE-7159) FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

[ https://issues.apache.org/jira/browse/MAPREDUCE-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16712010#comment-16712010 ] Jason Lowe commented on MAPREDUCE-7159: --- Thanks for updating the patch! +1 lgt

[jira] [Commented] (MAPREDUCE-7159) FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

[ https://issues.apache.org/jira/browse/MAPREDUCE-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16711728#comment-16711728 ] Jason Lowe commented on MAPREDUCE-7159: --- Looks good overall, just a few nits.

[jira] [Commented] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16706018#comment-16706018 ] Jason Lowe commented on MAPREDUCE-7167: --- I also think this is not going to be a

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16703379#comment-16703379 ] Jason Lowe commented on MAPREDUCE-7164: --- This case occurred when the namenode w

[jira] [Updated] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7164: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.1

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702377#comment-16702377 ] Jason Lowe commented on MAPREDUCE-7164: --- Thanks for updating the patch! +1 lgt

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16701077#comment-16701077 ] Jason Lowe commented on MAPREDUCE-7164: --- Thanks for the patch! I think it woul

[jira] [Updated] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7148: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Status:

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678291#comment-16678291 ] Jason Lowe commented on MAPREDUCE-7148: --- Unit test failures are unrelated. sur

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678274#comment-16678274 ] Jason Lowe commented on MAPREDUCE-7148: --- Thanks for updating the patch! +1 lgt

[jira] [Updated] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7156: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.3

[jira] [Commented] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677428#comment-16677428 ] Jason Lowe commented on MAPREDUCE-7156: --- According to some stuff I could scrape

[jira] [Commented] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677036#comment-16677036 ] Jason Lowe commented on MAPREDUCE-7156: --- Thanks for updating the patch! Weird,

[jira] [Commented] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676898#comment-16676898 ] Jason Lowe commented on MAPREDUCE-7156: --- Thanks for the report and patch! Curi

[jira] [Assigned] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7148: - Assignee: Wang Yan (was: Jason Lowe) Thanks for updating the patch! Apologies for t

[jira] [Assigned] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7148: - Assignee: Wang Yan (was: Jason Lowe) > Fast fail jobs when exceeds dfs quota limita

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16668838#comment-16668838 ] Jason Lowe commented on MAPREDUCE-7148: --- Thanks for updating the patch! Looks

[jira] [Commented] (MAPREDUCE-7152) LD_LIBRARY_PATH is always passed from MR AM to tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667178#comment-16667178 ] Jason Lowe commented on MAPREDUCE-7152: --- Can this be solved by simply changing:

[jira] [Commented] (MAPREDUCE-7155) TestHSAdminServer is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-7155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659744#comment-16659744 ] Jason Lowe commented on MAPREDUCE-7155: --- Per my comment on HADOOP-15836 I don't

[jira] [Commented] (MAPREDUCE-7155) TestHSAdminServer is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-7155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659083#comment-16659083 ] Jason Lowe commented on MAPREDUCE-7155: --- {noformat} [INFO] Running org.apache.h

[jira] [Created] (MAPREDUCE-7155) TestHSAdminServer is failing

Jason Lowe created MAPREDUCE-7155: - Summary: TestHSAdminServer is failing Key: MAPREDUCE-7155 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7155 Project: Hadoop Map/Reduce Issue Type:

[jira] [Updated] (MAPREDUCE-7149) javadocs for FileInputFormat and OutputFormat to mention DT collection

[ https://issues.apache.org/jira/browse/MAPREDUCE-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7149: -- Fix Version/s: 3.3.0 > javadocs for FileInputFormat and OutputFormat to mention DT collecti

[jira] [Commented] (MAPREDUCE-7149) javadocs for FileInputFormat and OutputFormat to mention DT collection

[ https://issues.apache.org/jira/browse/MAPREDUCE-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16646697#comment-16646697 ] Jason Lowe commented on MAPREDUCE-7149: --- Thanks for the patch! Other than the

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645034#comment-16645034 ] Jason Lowe commented on MAPREDUCE-7148: --- Unrecoverable works as long as the rea

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644118#comment-16644118 ] Jason Lowe commented on MAPREDUCE-7148: --- Thanks for the patch! Seems like a re

[jira] [Updated] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7130: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Status:

[jira] [Commented] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643914#comment-16643914 ] Jason Lowe commented on MAPREDUCE-7130: --- Thanks for the patch! +1 lgtm. Commi

[jira] [Commented] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16641819#comment-16641819 ] Jason Lowe commented on MAPREDUCE-7130: --- +1. This seems the most likely to fix

[jira] [Commented] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634684#comment-16634684 ] Jason Lowe commented on MAPREDUCE-7130: --- I'm not a Rumen expert and I haven't d

[jira] [Moved] (MAPREDUCE-7147) Review of LocalContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-8831 to MAPREDUCE-7147: - Affects Version/s: (was: 3.2.0) 3.2.0

[jira] [Moved] (MAPREDUCE-7146) Review of RMCommunicator Class

[ https://issues.apache.org/jira/browse/MAPREDUCE-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-8832 to MAPREDUCE-7146: - Affects Version/s: (was: 3.2.0) 3.2.0

[jira] [Updated] (MAPREDUCE-7138) ThrottledContainerAllocator in MRAppBenchmark should implement RMHeartbeatHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7138: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.6

[jira] [Updated] (MAPREDUCE-7137) MRAppBenchmark.benchmark1() fails with NullPointerException

[ https://issues.apache.org/jira/browse/MAPREDUCE-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7137: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.6

[jira] [Commented] (MAPREDUCE-7138) ThrottledContainerAllocator in MRAppBenchmark should implement RMHeartbeatHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619790#comment-16619790 ] Jason Lowe commented on MAPREDUCE-7138: --- Thanks for the report and patch! +1 l

[jira] [Commented] (MAPREDUCE-7137) MRAppBenchmark.benchmark1() fails with NullPointerException

[ https://issues.apache.org/jira/browse/MAPREDUCE-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619783#comment-16619783 ] Jason Lowe commented on MAPREDUCE-7137: --- Thanks for the report and patch! +1 f

[jira] [Commented] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619457#comment-16619457 ] Jason Lowe commented on MAPREDUCE-3801: --- No unit test since this is fixing the

[jira] [Updated] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-3801: -- Attachment: MAPREDUCE-3801.001.patch > org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstima

[jira] [Updated] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-3801: -- Target Version/s: 2.10.0, 3.2.0, 3.0.4, 2.9.2, 3.1.2, 2.8.6 Status: Patch Avai

[jira] [Assigned] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-3801: - Assignee: Jason Lowe Ran into this again, as it started failing semi-reliably on our

[jira] [Updated] (MAPREDUCE-7140) Refactoring TaskAttemptInfo to separate Map and Reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-7140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7140: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (MAPREDUCE-7140) Refactoring TaskAttemptInfo to separate Map and Reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-7140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16615317#comment-16615317 ] Jason Lowe commented on MAPREDUCE-7140: --- Thanks for the patch! +1 lgtm. Commi

[jira] [Resolved] (MAPREDUCE-6440) Duplicate Key in Json Output for Job details

[ https://issues.apache.org/jira/browse/MAPREDUCE-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6440. --- Resolution: Duplicate Target Version/s: (was: ) This has been fixed by MAPRED

[jira] [Updated] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7133: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.6

[jira] [Commented] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613971#comment-16613971 ] Jason Lowe commented on MAPREDUCE-7133: --- Thanks for updating the patch! +1 lgt

[jira] [Commented] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612812#comment-16612812 ] Jason Lowe commented on MAPREDUCE-7133: --- The problem with doing too much code c

[jira] [Commented] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611219#comment-16611219 ] Jason Lowe commented on MAPREDUCE-7133: --- Thanks for the nice analysis and patch

[jira] [Commented] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611160#comment-16611160 ] Jason Lowe commented on MAPREDUCE-7136: --- I would recommend opening a single tic

[jira] [Updated] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7136: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611032#comment-16611032 ] Jason Lowe commented on MAPREDUCE-7136: --- I'm fine with making a small improveme

[jira] [Commented] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610894#comment-16610894 ] Jason Lowe commented on MAPREDUCE-7136: --- Thanks for the report and patch! Test

[jira] [Updated] (MAPREDUCE-7135) TestTaskAttemptContainerRequest should reset UserGroupInformation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7135: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (MAPREDUCE-7135) TestTaskAttemptContainerRequest should reset UserGroupInformation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610866#comment-16610866 ] Jason Lowe commented on MAPREDUCE-7135: --- Thanks for the report and patches! +1

[jira] [Updated] (MAPREDUCE-7131) Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7131: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.2

[jira] [Commented] (MAPREDUCE-7131) Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606285#comment-16606285 ] Jason Lowe commented on MAPREDUCE-7131: --- Thanks for updating the patch! +1 lgt

[jira] [Commented] (MAPREDUCE-7131) Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603658#comment-16603658 ] Jason Lowe commented on MAPREDUCE-7131: --- Thanks for the report and patch! Are

[jira] [Commented] (MAPREDUCE-7126) Error communicating with RM: Resource Manager doesn't recognize AttemptId: appattempt_idxx

[ https://issues.apache.org/jira/browse/MAPREDUCE-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584113#comment-16584113 ] Jason Lowe commented on MAPREDUCE-7126: --- There needs to be more information on

[jira] [Resolved] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6948. --- Resolution: Cannot Reproduce I agree as well. I have not seen any recent precommit failu

[jira] [Updated] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

[ https://issues.apache.org/jira/browse/MAPREDUCE-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7118: -- Status: Patch Available (was: Open) Attaching a patch that essentially ports the fix for M

[jira] [Updated] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

[ https://issues.apache.org/jira/browse/MAPREDUCE-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7118: -- Attachment: MAPREDUCE-7118.001.patch > Distributed cache conflicts breaks backwards compata

[jira] [Created] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

Jason Lowe created MAPREDUCE-7118: - Summary: Distributed cache conflicts breaks backwards compatability Key: MAPREDUCE-7118 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7118 Project: Hadoop Map

[jira] [Updated] (MAPREDUCE-7086) Add config to allow FileInputFormat to ignore directories when recursive=false

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7086: -- Fix Version/s: 3.1.1 I committed this to branch-3.1 as well. > Add config to allow FileInpu

[jira] [Updated] (MAPREDUCE-7086) Add config to allow FileInputFormat to ignore directories when recursive=false

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7086: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Updated] (MAPREDUCE-7086) Add config to allow FileInputFormat to ignore directories when recursive=false

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7086: -- Summary: Add config to allow FileInputFormat to ignore directories when recursive=false

[jira] [Commented] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460170#comment-16460170 ] Jason Lowe commented on MAPREDUCE-7086: --- My apologies for the delay. +1 lgtm, c

[jira] [Commented] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16450120#comment-16450120 ] Jason Lowe commented on MAPREDUCE-7086: --- Thanks for updating the patch! Would i

[jira] [Commented] (MAPREDUCE-7026) Shuffle Fetcher does not log the actual error message thrown by ShuffleHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16450052#comment-16450052 ] Jason Lowe commented on MAPREDUCE-7026: --- Thanks for the report and the patch! T

[jira] [Assigned] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7086: - Assignee: Sergey Shelukhin > FileInputFormat recursive=false fails instead of ignorin

[jira] [Commented] (MAPREDUCE-7084) MRAppmaster still running after hadoop job -kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16444347#comment-16444347 ] Jason Lowe commented on MAPREDUCE-7084: --- Looks like the AM was not able to succe

[jira] [Updated] (MAPREDUCE-7081) Default speculator won't speculate the last several submitted reduced task if the total task num is large

[ https://issues.apache.org/jira/browse/MAPREDUCE-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7081: -- Summary: Default speculator won't speculate the last several submitted reduced task if the t

[jira] [Resolved] (MAPREDUCE-7080) Default speculator won't sepculate the last several submitted reduced task if the total task num is large

[ https://issues.apache.org/jira/browse/MAPREDUCE-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-7080. --- Resolution: Duplicate Closing as a duplicate of MAPREDUCE-7081. > Default speculator won'

[jira] [Updated] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7069: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Release Note:

[jira] [Updated] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7069: -- Release Note: Environment variables for MapReduce tasks can now be specified as separate pr

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16435838#comment-16435838 ] Jason Lowe commented on MAPREDUCE-7069: --- +1 lgtm as well. The two unit tests th

[jira] [Created] (MAPREDUCE-7079) TestMRIntermediateDataEncryption is failing in precommit builds

Jason Lowe created MAPREDUCE-7079: - Summary: TestMRIntermediateDataEncryption is failing in precommit builds Key: MAPREDUCE-7079 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7079 Project: Hado

[jira] [Created] (MAPREDUCE-7078) TestPipeApplication is failing in precommit builds

Jason Lowe created MAPREDUCE-7078: - Summary: TestPipeApplication is failing in precommit builds Key: MAPREDUCE-7078 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7078 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16434021#comment-16434021 ] Jason Lowe commented on MAPREDUCE-7069: --- Given this is XML and not HTML I think

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433021#comment-16433021 ] Jason Lowe commented on MAPREDUCE-7069: --- Thanks for updating the patch! We're g

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431378#comment-16431378 ] Jason Lowe commented on MAPREDUCE-7069: --- Thanks for updating the patch! Looks l

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16425770#comment-16425770 ] Jason Lowe commented on MAPREDUCE-7069: --- Thanks for the patch! It's a bit odd a

[jira] [Commented] (MAPREDUCE-7068) Fix Reduce Exception was overwrited by ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409763#comment-16409763 ] Jason Lowe commented on MAPREDUCE-7068: --- Is there a real problem here or a theor

[jira] [Commented] (MAPREDUCE-7068) Fix Reduce Exception was overwrited by ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409685#comment-16409685 ] Jason Lowe commented on MAPREDUCE-7068: --- Errors are much more severe than Except

[jira] [Commented] (MAPREDUCE-7068) Fix Reduce Exception was overwrited by ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409561#comment-16409561 ] Jason Lowe commented on MAPREDUCE-7068: --- Is this reported against 2.7 or somethi

[jira] [Commented] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16408655#comment-16408655 ] Jason Lowe commented on MAPREDUCE-6948: --- It looks like this was reported against

[jira] [Updated] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7064: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2

[jira] [Commented] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399209#comment-16399209 ] Jason Lowe commented on MAPREDUCE-7064: --- +1 lgtm. I'll clean up the unused impo

[jira] [Commented] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398694#comment-16398694 ] Jason Lowe commented on MAPREDUCE-7064: --- Thanks for updating the patch! Just no

[jira] [Commented] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16397175#comment-16397175 ] Jason Lowe commented on MAPREDUCE-7064: --- Thanks for the patch! Looks like a rea

[jira] [Updated] (MAPREDUCE-6930) mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6930: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2

[jira] [Commented] (MAPREDUCE-6930) mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16393129#comment-16393129 ] Jason Lowe commented on MAPREDUCE-6930: --- Thanks for the patch! +1 lgtm. Commit

[jira] [Assigned] (MAPREDUCE-6930) mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-6930: - Assignee: Sen Zhao > mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are bot

[jira] [Commented] (MAPREDUCE-7059) Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382079#comment-16382079 ] Jason Lowe commented on MAPREDUCE-7059: --- Should this go into branch-3.0 as well

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7060: -- Description: It's easier for downstream apps like Spark to pick up the new PathOutputCommit

[jira] [Commented] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16380330#comment-16380330 ] Jason Lowe commented on MAPREDUCE-7059: --- +1 lgtm. > Compatibility issue: job su

[jira] [Commented] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16376919#comment-16376919 ] Jason Lowe commented on MAPREDUCE-7059: --- Thanks for the report! This was introd

[jira] [Moved] (MAPREDUCE-7059) Compatibility issue: throw RpcNoSuchMethodException when run mapreduce job

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-7970 to MAPREDUCE-7059: - Affects Version/s: (was: 3.0.0) 3.0.0

[jira] [Updated] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7059: -- Summary: Compatibility issue: job submission fails with RpcNoSuchMethodException when submit

[jira] [Updated] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7053: -- Affects Version/s: (was: 2.7.6) Target Version/s: 3.1.0, 3.0.1, 2.10.0, 2.9.1, 2.8.4

[jira] [Updated] (MAPREDUCE-7052) TestFixedLengthInputFormat#testFormatCompressedIn is flaky

[ https://issues.apache.org/jira/browse/MAPREDUCE-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7052: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.6

[jira] [Commented] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366266#comment-16366266 ] Jason Lowe commented on MAPREDUCE-7053: --- Thanks for the reviews! Here's the equi

  1   2   3   4   5   6   7   8   9   10   >