[jira] [Commented] (HADOOP-15206) BZip2 drops and duplicates records when input split size is small

2018-02-05 Thread Aki Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353510#comment-16353510 ] Aki Tanaka commented on HADOOP-15206: - [~jlowe] Thank you for your insights. I have

[jira] [Updated] (HADOOP-15206) BZip2 drops and duplicates records when input split size is small

2018-02-05 Thread Aki Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aki Tanaka updated HADOOP-15206: Attachment: HADOOP-15206.001.patch > BZip2 drops and duplicates records when input split size is s

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353264#comment-16353264 ] genericqa commented on HADOOP-10571: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353214#comment-16353214 ] genericqa commented on HADOOP-15007: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Updated] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15007: Status: Patch Available (was: Open) > Stabilize and document Configuration element > ---

[jira] [Created] (HADOOP-15211) Distcp update not preserving root directory permissions

2018-02-05 Thread PRASHANT GOLASH (JIRA)
PRASHANT GOLASH created HADOOP-15211: Summary: Distcp update not preserving root directory permissions Key: HADOOP-15211 URL: https://issues.apache.org/jira/browse/HADOOP-15211 Project: Hadoop Comm

[jira] [Commented] (HADOOP-15134) ADL problems parsing JSON responses to include error details

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353086#comment-16353086 ] Steve Loughran commented on HADOOP-15134: - FWIW, suspect underlying cause is end

[jira] [Commented] (HADOOP-15204) Add Configuration API for parsing storage sizes

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353064#comment-16353064 ] genericqa commented on HADOOP-15204: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-15209) PoC: DistCp to eliminate needless deletion of files under deleted directories

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15209: Status: Open (was: Patch Available) > PoC: DistCp to eliminate needless deletion of files

[jira] [Assigned] (HADOOP-15209) PoC: DistCp to eliminate needless deletion of files under deleted directories

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15209: --- Assignee: Steve Loughran > PoC: DistCp to eliminate needless deletion of files unde

[jira] [Created] (HADOOP-15210) Handle FNFE from S3Guard.getMetadataStore() in S3A initialize()

2018-02-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15210: --- Summary: Handle FNFE from S3Guard.getMetadataStore() in S3A initialize() Key: HADOOP-15210 URL: https://issues.apache.org/jira/browse/HADOOP-15210 Project: Hado

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353044#comment-16353044 ] Andras Bokor commented on HADOOP-10571: --- {quote} h4. LocalFileSystem L142 we coul

[jira] [Updated] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-05 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HADOOP-10571: -- Attachment: HADOOP-10571.05.patch > Use Log.*(Object, Throwable) overload to log exceptions >

[jira] [Commented] (HADOOP-14468) S3Guard: make short-circuit getFileStatus() configurable

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16353020#comment-16353020 ] Steve Loughran commented on HADOOP-14468: - One thing related to this is whether

[jira] [Updated] (HADOOP-14918) remove the Local Dynamo DB test option

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14918: Status: Open (was: Patch Available) > remove the Local Dynamo DB test option > --

[jira] [Commented] (HADOOP-15204) Add Configuration API for parsing storage sizes

2018-02-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352956#comment-16352956 ] Anu Engineer commented on HADOOP-15204: --- [~ste...@apache.org], [~chris.douglas] Th

[jira] [Updated] (HADOOP-15204) Add Configuration API for parsing storage sizes

2018-02-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HADOOP-15204: -- Attachment: HADOOP-15204.003.patch > Add Configuration API for parsing storage sizes > ---

[jira] [Commented] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352934#comment-16352934 ] Ajay Kumar commented on HADOOP-15007: - [~ste...@apache.org],[~anu],[~elek] thanks fo

[jira] [Updated] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15007: Attachment: HADOOP-15007.000.patch > Stabilize and document Configuration element > -

[jira] [Updated] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15007: Attachment: (was: HADOOP-15007.000.patch) > Stabilize and document Configuration element > --

[jira] [Updated] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15007: Attachment: HADOOP-15007.000.patch > Stabilize and document Configuration element > -

[jira] [Commented] (HADOOP-15209) PoC: DistCp to eliminate needless deletion of files under deleted directories

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352906#comment-16352906 ] genericqa commented on HADOOP-15209: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-02-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352889#comment-16352889 ] Sanjay Radia commented on HADOOP-15191: --- Steve, can you please explain how this wi

[jira] [Commented] (HADOOP-15203) Support composite trusted channel resolver that supports both whitelist and blacklist

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352857#comment-16352857 ] genericqa commented on HADOOP-15203: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2018-02-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HADOOP-11867: - Labels: performance (was: ) > FS API: Add a high-performance vectored Read to FSDataInputStream API > -

[jira] [Updated] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2018-02-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HADOOP-11867: - Affects Version/s: (was: 2.8.0) 3.0.0 > FS API: Add a high-performance vector

[jira] [Updated] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2018-02-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HADOOP-11867: - Component/s: hdfs-client > FS API: Add a high-performance vectored Read to FSDataInputStream API > -

[jira] [Updated] (HADOOP-15209) PoC: DistCp to eliminate needless deletion of files under deleted directories

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15209: Status: Patch Available (was: Open) > PoC: DistCp to eliminate needless deletion of files

[jira] [Created] (HADOOP-15209) PoC: DistCp to eliminate needless deletion of files under deleted directories

2018-02-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15209: --- Summary: PoC: DistCp to eliminate needless deletion of files under deleted directories Key: HADOOP-15209 URL: https://issues.apache.org/jira/browse/HADOOP-15209

[jira] [Commented] (HADOOP-15209) PoC: DistCp to eliminate needless deletion of files under deleted directories

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352741#comment-16352741 ] Steve Loughran commented on HADOOP-15209: - HADOOP-15209 patch 001   this build

[jira] [Updated] (HADOOP-15209) PoC: DistCp to eliminate needless deletion of files under deleted directories

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15209: Attachment: HADOOP-15209-001.patch > PoC: DistCp to eliminate needless deletion of files u

[jira] [Commented] (HADOOP-15208) DistCp to offer option to save src/dest filesets as alternative to delete()

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352729#comment-16352729 ] Steve Loughran commented on HADOOP-15208: - See HADOOP-15191 as one scale strateg

[jira] [Created] (HADOOP-15208) DistCp to offer option to save src/dest filesets as alternative to delete()

2018-02-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15208: --- Summary: DistCp to offer option to save src/dest filesets as alternative to delete() Key: HADOOP-15208 URL: https://issues.apache.org/jira/browse/HADOOP-15208 P

[jira] [Updated] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15191: Status: Open (was: Patch Available) > Add Private/Unstable BulkDelete operations to suppo

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352722#comment-16352722 ] Steve Loughran commented on HADOOP-10571: - It's way past time to get this in, so

[jira] [Updated] (HADOOP-15203) Support composite trusted channel resolver that supports both whitelist and blacklist

2018-02-05 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15203: Attachment: HADOOP-15203.001.patch > Support composite trusted channel resolver that supports both

[jira] [Commented] (HADOOP-6852) apparent bug in concatenated-bzip2 support (decoding)

2018-02-05 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352392#comment-16352392 ] Zsolt Venczel commented on HADOOP-6852: --- In the attached patch I have added previou

[jira] [Commented] (HADOOP-6852) apparent bug in concatenated-bzip2 support (decoding)

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352394#comment-16352394 ] genericqa commented on HADOOP-6852: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (HADOOP-6852) apparent bug in concatenated-bzip2 support (decoding)

2018-02-05 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel reassigned HADOOP-6852: - Assignee: Zsolt Venczel > apparent bug in concatenated-bzip2 support (decoding) > --

[jira] [Updated] (HADOOP-6852) apparent bug in concatenated-bzip2 support (decoding)

2018-02-05 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HADOOP-6852: -- Status: Patch Available (was: Open) > apparent bug in concatenated-bzip2 support (decoding) >

[jira] [Updated] (HADOOP-6852) apparent bug in concatenated-bzip2 support (decoding)

2018-02-05 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zsolt Venczel updated HADOOP-6852: -- Attachment: HADOOP-6852.01.patch > apparent bug in concatenated-bzip2 support (decoding) >

[jira] [Comment Edited] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352138#comment-16352138 ] Elek, Marton edited comment on HADOOP-15007 at 2/5/18 8:31 AM: ---

[jira] [Commented] (HADOOP-15007) Stabilize and document Configuration element

2018-02-05 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352138#comment-16352138 ] Elek, Marton commented on HADOOP-15007: --- +1 for separaing action item 3. +0 for a