[jira] [Resolved] (MAPREDUCE-3236) Distcp with hdfs:// passed with error in JT log while copying from .20.204 to .20.205 ( with useIp=false)

2018-09-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved MAPREDUCE-3236. --- Resolution: Won't Fix this problem is too old; not going to be fixed I'm afraid.

[jira] [Updated] (MAPREDUCE-7091) Speed up terasort on S3a

2018-08-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7091: -- Target Version/s: (was: 3.2.0) > Speed up terasort on S3a >

[jira] [Resolved] (MAPREDUCE-6974) Add standard configuration keys for HTrace values, propagate across to MR committers if set

2018-08-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved MAPREDUCE-6974. --- Resolution: Won't Fix > Add standard configuration keys for HTrace values,

[jira] [Commented] (MAPREDUCE-7101) Revisit behavior of JHS scan file behavior

2018-06-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503288#comment-16503288 ] Steve Loughran commented on MAPREDUCE-7101: --- +[~Thomas Demoor], [~fabbri], [~ehiggs] >

[jira] [Commented] (MAPREDUCE-7101) Revisit behavior of JHS scan file behavior

2018-06-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503287#comment-16503287 ] Steve Loughran commented on MAPREDUCE-7101: --- * as noted by Wangda, S3 doesn' t have a

[jira] [Updated] (MAPREDUCE-6885) JobHistory event handling does not complete if handling event throws exception on shutdown

2018-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6885: -- Target Version/s: 2.7.8 (was: 2.7.7) > JobHistory event handling does not

[jira] [Commented] (MAPREDUCE-7092) MR examples to work better against cloud stores

2018-05-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460915#comment-16460915 ] Steve Loughran commented on MAPREDUCE-7092: --- Be a chance for MAPREDUCE-5907 to demonstrate

[jira] [Updated] (MAPREDUCE-7090) BigMapOutput example doesn't work with paths off cluster fs

2018-05-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7090: -- Issue Type: Sub-task (was: Bug) Parent: MAPREDUCE-7092 > BigMapOutput

[jira] [Updated] (MAPREDUCE-7091) Speed up terasort on S3a

2018-05-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7091: -- Issue Type: Sub-task (was: Improvement) Parent: MAPREDUCE-7092 > Speed up

[jira] [Created] (MAPREDUCE-7092) MR examples to work better against cloud stores

2018-05-01 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-7092: - Summary: MR examples to work better against cloud stores Key: MAPREDUCE-7092 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7092 Project: Hadoop

[jira] [Created] (MAPREDUCE-7091) Speed up terasort on S3a

2018-05-01 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-7091: - Summary: Speed up terasort on S3a Key: MAPREDUCE-7091 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7091 Project: Hadoop Map/Reduce Issue

[jira] [Commented] (MAPREDUCE-7090) BigMapOutput example doesn't work with paths off cluster fs

2018-04-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458638#comment-16458638 ] Steve Loughran commented on MAPREDUCE-7090: --- {code} > hadoop jar

[jira] [Created] (MAPREDUCE-7090) BigMapOutput example doesn't work with paths off cluster fs

2018-04-30 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-7090: - Summary: BigMapOutput example doesn't work with paths off cluster fs Key: MAPREDUCE-7090 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7090 Project:

[jira] [Commented] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

2018-04-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16456193#comment-16456193 ] Steve Loughran commented on MAPREDUCE-7086: --- Sergey: sorry, I'm not skilled enough in this

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0

2018-03-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7060: -- Resolution: Fixed Target Version/s: 3.0.2 (was: 3.0.1, 2.10.0)

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0

2018-03-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7060: -- Summary: Cherry Pick PathOutputCommitter class/factory to branch-3.0 (was: Cherry

[jira] [Commented] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-03-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16381805#comment-16381805 ] Steve Loughran commented on MAPREDUCE-7060: --- thanks! > Cherry Pick PathOutputCommitter

[jira] [Commented] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380654#comment-16380654 ] Steve Loughran commented on MAPREDUCE-7060: --- checkstyles are about javadoc link line width;

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7060: -- Attachment: MAPREDUCE-7060-branch-3.0-002.patch > Cherry Pick PathOutputCommitter

[jira] [Commented] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377158#comment-16377158 ] Steve Loughran commented on MAPREDUCE-7060: --- patch 002; including TestMapreduceConfigFields

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7060: -- Status: Patch Available (was: Open) > Cherry Pick PathOutputCommitter

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7060: -- Status: Open (was: Patch Available) > Cherry Pick PathOutputCommitter

[jira] [Commented] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377087#comment-16377087 ] Steve Loughran commented on MAPREDUCE-7060: --- For branch-3 we just need to pull in the final

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7060: -- Status: Patch Available (was: Open) > Cherry Pick PathOutputCommitter

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7060: -- Attachment: MAPREDUCE-7060-branch-3.0-001.patch > Cherry Pick PathOutputCommitter

[jira] [Created] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

2018-02-26 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-7060: - Summary: Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10 Key: MAPREDUCE-7060 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7060

[jira] [Resolved] (MAPREDUCE-6961) Pull up FileOutputCommitter.getOutputPath to PathOutputCommitter

2018-02-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved MAPREDUCE-6961. --- Resolution: Duplicate Fix Version/s: 3.1.0 This went in with HADOOP-13786

[jira] [Updated] (MAPREDUCE-6760) LocatedFileStatusFetcher to use listFiles(recursive)

2018-02-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6760: -- Target Version/s: 3.2.0 (was: 3.1.0) > LocatedFileStatusFetcher to use

[jira] [Updated] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2018-02-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-5907: -- Labels: (was: BB2015-05-TBR) > Improve getSplits() performance for fs

[jira] [Commented] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2018-02-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360698#comment-16360698 ] Steve Loughran commented on MAPREDUCE-5907: --- Catching up on this after spending many weeks

[jira] [Commented] (MAPREDUCE-7029) FileOutputCommitter is slow on filesystems lacking recursive delete

2018-01-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336069#comment-16336069 ] Steve Loughran commented on MAPREDUCE-7029: --- bq. I don't think I could have delved into the

[jira] [Commented] (MAPREDUCE-7029) FileOutputCommitter is slow on filesystems lacking recursive delete

2018-01-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332693#comment-16332693 ] Steve Loughran commented on MAPREDUCE-7029: --- bq. I don't think FileOutputCommiter actually

[jira] [Updated] (MAPREDUCE-7014) Fix java doc errors in jdk1.8

2017-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7014: -- Status: Patch Available (was: Open) > Fix java doc errors in jdk1.8 >

[jira] [Updated] (MAPREDUCE-7014) Fix java doc errors in jdk1.8

2017-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7014: -- Attachment: MAPREDUCE-7014-002.patch I'll do it here. Patch 002: fixes *all*

[jira] [Updated] (MAPREDUCE-7014) Fix java doc errors in jdk1.8

2017-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7014: -- Status: Open (was: Patch Available) > Fix java doc errors in jdk1.8 >

[jira] [Updated] (MAPREDUCE-7014) Fix java doc errors in jdk1.8

2017-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7014: -- Affects Version/s: 3.1.0 Target Version/s: 3.1.0 Status: Patch

[jira] [Updated] (MAPREDUCE-7014) Fix java doc errors in jdk1.8

2017-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-7014: -- Attachment: MAPREDUCE-7014-001.patch Patch 001; fix the javadocs; tested locally.

[jira] [Assigned] (MAPREDUCE-7014) Fix java doc errors in jdk1.8

2017-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned MAPREDUCE-7014: - Assignee: Steve Loughran > Fix java doc errors in jdk1.8 >

[jira] [Commented] (MAPREDUCE-7014) Fix java doc errors in jdk1.8

2017-11-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266709#comment-16266709 ] Steve Loughran commented on MAPREDUCE-7014: --- my fault, I'll fix. > Fix java doc errors in

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was:

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Attachment: (was: MAPREDUCE-6823-004.patch) > FileOutputFormat to support

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Patch Available (was: Open) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Attachment: MAPREDUCE-6823-004.patch > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Open (was: Patch Available) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Patch Available (was: Open) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Attachment: MAPREDUCE-6823-004.patch Patch 004; in sync with the S3A patch being

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-11-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Open (was: Patch Available) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-31 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Patch Available (was: Open) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Open (was: Patch Available) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6977) Moving logging APIs over to slf4j in hadoop-mapreduce-client-common

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6977: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Moving logging

[jira] [Updated] (MAPREDUCE-6977) Moving logging APIs over to slf4j in hadoop-mapreduce-client-common

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6977: -- Affects Version/s: 3.0.0 Fix Version/s: 3.1.0 Description:

[jira] [Commented] (MAPREDUCE-6977) Moving logging APIs over to slf4j in hadoop-mapreduce-client-common

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222004#comment-16222004 ] Steve Loughran commented on MAPREDUCE-6977: --- LGTM +1 > Moving logging APIs over to slf4j

[jira] [Updated] (MAPREDUCE-6983) Moving logging APIs over to slf4j in hadoop-mapreduce-client-core

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6983: -- Affects Version/s: 3.0.0 Target Version/s: 3.1.0 Status: Patch

[jira] [Commented] (MAPREDUCE-6983) Moving logging APIs over to slf4j in hadoop-mapreduce-client-core

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222002#comment-16222002 ] Steve Loughran commented on MAPREDUCE-6983: --- ASF license failure off a temp patch file; not

[jira] [Updated] (MAPREDUCE-6983) Moving logging APIs over to slf4j in hadoop-mapreduce-client-core

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6983: -- Status: Open (was: Patch Available) > Moving logging APIs over to slf4j in

[jira] [Updated] (MAPREDUCE-6983) Moving logging APIs over to slf4j in hadoop-mapreduce-client-core

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6983: -- Attachment: MAPREDUCE-6983.005.patch reattaching patch 005 to resubmit & see what

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Attachment: MAPREDUCE-6823-002.patch > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Patch Available (was: Open) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Open (was: Patch Available) > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Target Version/s: 3.1.0 (was: 3.0.0) Status: Patch Available (was:

[jira] [Commented] (MAPREDUCE-5196) CheckpointAMPreemptionPolicy implements preemption in MR AM via checkpointing

2017-10-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203956#comment-16203956 ] Steve Loughran commented on MAPREDUCE-5196: --- Right. I'm staring at this code too, looking at

[jira] [Commented] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16203466#comment-16203466 ] Steve Loughran commented on MAPREDUCE-6823: --- Patch 002 This is the mapreduce part of the

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Attachment: MAPREDUCE-6823-002.patch > FileOutputFormat to support configurable

[jira] [Updated] (MAPREDUCE-6974) Add standard configuration keys for HTrace values, propagate across to MR committers if set

2017-10-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6974: -- Summary: Add standard configuration keys for HTrace values, propagate across to MR

[jira] [Commented] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-10-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191115#comment-16191115 ] Steve Loughran commented on MAPREDUCE-6823: --- no, I've been doing work on this in my

[jira] [Created] (MAPREDUCE-6974) Add standard configuration keys for Htrace values, propagate across to MR committers if set

2017-10-03 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-6974: - Summary: Add standard configuration keys for Htrace values, propagate across to MR committers if set Key: MAPREDUCE-6974 URL:

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

2017-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Summary: FileOutputFormat to support configurable PathOutputCommitter factory

[jira] [Created] (MAPREDUCE-6961) Pull up FileOutputCommitter.getOutputPath to PathOutputCommitter

2017-09-19 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-6961: - Summary: Pull up FileOutputCommitter.getOutputPath to PathOutputCommitter Key: MAPREDUCE-6961 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6961

[jira] [Updated] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6956: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved

[jira] [Updated] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6956: -- Attachment: MAPREDUCE-6956-002.patch thanks, this is the patch I'm committing:

[jira] [Updated] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6956: -- Status: Patch Available (was: Open) > FileOutputCommitter to gain abstract

[jira] [Updated] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6956: -- Status: Open (was: Patch Available) > FileOutputCommitter to gain abstract

[jira] [Commented] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167582#comment-16167582 ] Steve Loughran commented on MAPREDUCE-6956: --- great! thx for the review. I'll do the cleanup

[jira] [Updated] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6956: -- Priority: Minor (was: Major) > FileOutputCommitter to gain abstract superclass

[jira] [Updated] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6956: -- Status: Patch Available (was: Open) > FileOutputCommitter to gain abstract

[jira] [Updated] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6956: -- Attachment: MAPREDUCE-6956-001.patch Patch 001 This is the code from MAPREDUC-6823

[jira] [Created] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-08 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-6956: - Summary: FileOutputCommitter to gain abstract superclass PathOutputCommitter Key: MAPREDUCE-6956 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6956

[jira] [Updated] (MAPREDUCE-6760) LocatedFileStatusFetcher to use listFiles(recursive)

2017-09-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6760: -- Target Version/s: 3.1.0 > LocatedFileStatusFetcher to use listFiles(recursive) >

[jira] [Commented] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2017-08-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124971#comment-16124971 ] Steve Loughran commented on MAPREDUCE-4980: --- I'd steer clear of checkstyles, as, while

[jira] [Commented] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2017-08-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124568#comment-16124568 ] Steve Loughran commented on MAPREDUCE-4980: --- good piece of maintenance on the tests here,

[jira] [Commented] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2017-08-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123088#comment-16123088 ] Steve Loughran commented on MAPREDUCE-4980: --- If its going through configs & is splnning up a

[jira] [Commented] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2017-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118153#comment-16118153 ] Steve Loughran commented on MAPREDUCE-4980: --- if you look at the S3A (and soon WASB) parallel

[jira] [Updated] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2017-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-5907: -- Status: Open (was: Patch Available) > Improve getSplits() performance for fs

[jira] [Updated] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2017-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-5907: -- Status: Patch Available (was: Open) > Improve getSplits() performance for fs

[jira] [Commented] (MAPREDUCE-6823) FileOutputFormat to support configurable FileOutputCommitter factory

2017-06-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061332#comment-16061332 ] Steve Loughran commented on MAPREDUCE-6823: --- **2017/06/23 update** no, that's just messy.

[jira] [Commented] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2017-04-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967303#comment-15967303 ] Steve Loughran commented on MAPREDUCE-5907: --- seems good. don't feel bad about pinging me

[jira] [Commented] (MAPREDUCE-5907) Improve getSplits() performance for fs implementations that can utilize performance gains from recursive listing

2017-04-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965716#comment-15965716 ] Steve Loughran commented on MAPREDUCE-5907: --- I don't know anyone looking at it. It's an out

[jira] [Commented] (MAPREDUCE-6840) Distcp to support cutoff time

2017-03-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15943218#comment-15943218 ] Steve Loughran commented on MAPREDUCE-6840: --- milis is a pretty human-unfriendly number; the

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable FileOutputCommitter factory

2017-01-09 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Open (was: Patch Available) Cancelling this PoC; redesigning. In order to

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable FileOutputCommitter factory

2016-12-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Attachment: HADOOP-13786-HADOOP-13345-001.patch This is the initial HADOOP-13786

[jira] [Updated] (MAPREDUCE-6823) FileOutputFormat to support configurable FileOutputCommitter factory

2016-12-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6823: -- Status: Patch Available (was: Open) > FileOutputFormat to support configurable

[jira] [Created] (MAPREDUCE-6823) FileOutputFormat to support configurable FileOutputCommitter factory

2016-12-14 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-6823: - Summary: FileOutputFormat to support configurable FileOutputCommitter factory Key: MAPREDUCE-6823 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6823

[jira] [Commented] (MAPREDUCE-6760) LocatedFileStatusFetcher to use listFiles(recursive)

2016-12-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742512#comment-15742512 ] Steve Loughran commented on MAPREDUCE-6760: --- one problem here is that it's using

[jira] [Commented] (MAPREDUCE-6790) Update jackson from 1.9.13 to 2.x in hadoop-mapreduce

2016-11-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15639947#comment-15639947 ] Steve Loughran commented on MAPREDUCE-6790: --- +1 > Update jackson from 1.9.13 to 2.x in

[jira] [Created] (MAPREDUCE-6800) FileInputFormat.singleThreadedListStatus to use listFiles(recursive)

2016-10-24 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-6800: - Summary: FileInputFormat.singleThreadedListStatus to use listFiles(recursive) Key: MAPREDUCE-6800 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6800

[jira] [Updated] (MAPREDUCE-6760) LocatedFileStatusFetcher to use listFiles(recursive)

2016-10-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6760: -- Description: {{LocatedFileStatusFetcher}} does parallelized path listing, but it

[jira] [Commented] (MAPREDUCE-6760) LocatedFileStatusFetcher to use listFiles(recursive)

2016-08-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426143#comment-15426143 ] Steve Loughran commented on MAPREDUCE-6760: --- Note that if we find that listFiles isn't

[jira] [Created] (MAPREDUCE-6760) LocatedFileStatusFetcher to use listFiles(recursive)

2016-08-18 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-6760: - Summary: LocatedFileStatusFetcher to use listFiles(recursive) Key: MAPREDUCE-6760 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6760 Project: Hadoop

[jira] [Updated] (MAPREDUCE-6639) Process hangs in LocatedFileStatusFetcher if FileSystem.get throws

2016-05-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated MAPREDUCE-6639: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (MAPREDUCE-6564) distcp creates missing perent directories which is inconsistent with fs -cp

2015-12-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044815#comment-15044815 ] Steve Loughran commented on MAPREDUCE-6564: --- this is going to break so many things. It'll

<    1   2   3   4   5   6   >