[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

2018-01-29 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HADOOP-15189: --- Fix Version/s: 2.10.0 > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Assigned] (HADOOP-15171) Hadoop native ZLIB decompressor produces 0 bytes for some input

2018-01-29 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HADOOP-15171: - Assignee: Lokesh Jain > Hadoop native ZLIB decompressor produces 0

[jira] [Commented] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344497#comment-16344497 ] genericqa commented on HADOOP-15191: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-15186) Allow Azure Data Lake SDK dependency version to be set on the command line

2018-01-29 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344463#comment-16344463 ] Vishwajeet Dusane edited comment on HADOOP-15186 at 1/30/18 3:54 AM: -

[jira] [Commented] (HADOOP-15186) Allow Azure Data Lake SDK dependency version to be set on the command line

2018-01-29 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344463#comment-16344463 ] Vishwajeet Dusane commented on HADOOP-15186: Thanks [~ste...@apache.org] > Allow Azure Data

[jira] [Updated] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15191: Status: Patch Available (was: Open) > Add Private/Unstable BulkDelete operations to

[jira] [Comment Edited] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344385#comment-16344385 ] Steve Loughran edited comment on HADOOP-15191 at 1/30/18 2:00 AM: -- h2.

[jira] [Commented] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344385#comment-16344385 ] Steve Loughran commented on HADOOP-15191: - h2. Proposed * New interface

[jira] [Commented] (HADOOP-15168) Add kdiag tool to hadoop command

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344383#comment-16344383 ] genericqa commented on HADOOP-15168: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15191: Attachment: HADOOP-15191-002.patch > Add Private/Unstable BulkDelete operations to

[jira] [Updated] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15191: Status: Open (was: Patch Available) > Add Private/Unstable BulkDelete operations to

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344320#comment-16344320 ] genericqa commented on HADOOP-12897: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15168) Add kdiag tool to hadoop command

2018-01-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344300#comment-16344300 ] Bharat Viswanadham commented on HADOOP-15168: - Hi [~hanishakoneru] Thank you for review.

[jira] [Updated] (HADOOP-15168) Add kdiag tool to hadoop command

2018-01-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HADOOP-15168: Attachment: HADOOP-15168.02.patch > Add kdiag tool to hadoop command >

[jira] [Commented] (HADOOP-15171) Hadoop native ZLIB decompressor produces 0 bytes for some input

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344268#comment-16344268 ] Steve Loughran commented on HADOOP-15171: - There was another JIRA on this wasn't there? Sergei,

[jira] [Commented] (HADOOP-15171) Hadoop native ZLIB decompressor produces 0 bytes for some input

2018-01-29 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344204#comment-16344204 ] Gopal V commented on HADOOP-15171: -- bq. this is becoming a pain This is a huge perf hit right now,

[jira] [Commented] (HADOOP-15140) S3guard mistakes root URI without / as non-absolute path

2018-01-29 Thread Abraham Fine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344201#comment-16344201 ] Abraham Fine commented on HADOOP-15140: --- [~ste...@apache.org] I went ahead and added two tests to

[jira] [Updated] (HADOOP-15171) Hadoop native ZLIB decompressor produces 0 bytes for some input

2018-01-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HADOOP-15171: -- Priority: Blocker (was: Critical) > Hadoop native ZLIB decompressor produces 0 bytes

[jira] [Commented] (HADOOP-15171) Hadoop native ZLIB decompressor produces 0 bytes for some input

2018-01-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344184#comment-16344184 ] Sergey Shelukhin commented on HADOOP-15171: --- [~ste...@apache.org] [~jnp] is it possible to get

[jira] [Updated] (HADOOP-15171) Hadoop native ZLIB decompressor produces 0 bytes for some input

2018-01-29 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HADOOP-15171: -- Fix Version/s: 3.0.1 3.1.0 > Hadoop native ZLIB decompressor

[jira] [Updated] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-12897: Attachment: HADOOP-12897.004.patch > KerberosAuthenticator.authenticate to include URL on IO

[jira] [Updated] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-12897: Attachment: (was: HADOOP-12897.004.patch) > KerberosAuthenticator.authenticate to include URL

[jira] [Updated] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-12897: Attachment: HADOOP-12897.004.patch > KerberosAuthenticator.authenticate to include URL on IO

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344165#comment-16344165 ] Ajay Kumar commented on HADOOP-12897: - Patch v4 adds log message at DEBUG level to address

[jira] [Comment Edited] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344139#comment-16344139 ] Ajay Kumar edited comment on HADOOP-12897 at 1/29/18 10:46 PM: ---

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344139#comment-16344139 ] Ajay Kumar commented on HADOOP-12897: - [~arpitagarwal], thanks for suggestion. Using multi-catch in

[jira] [Commented] (HADOOP-15191) Add Private/Unstable BulkDelete operations to supporting object stores for DistCP

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344136#comment-16344136 ] Steve Loughran commented on HADOOP-15191: - The patch I'm working on now (bigger, passing tests)

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-01-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344105#comment-16344105 ] Xiao Chen commented on HADOOP-14445: Thanks [~daryn] for circling back with the new idea. Mixed

[jira] [Commented] (HADOOP-15129) Datanode caches namenode DNS lookup failure and cannot startup

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344037#comment-16344037 ] Ajay Kumar commented on HADOOP-15129: - {quote}local host is: (unknown); {quote} can we pass

[jira] [Commented] (HADOOP-15170) Add symlink support to FileUtil#unTarUsingJava

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344003#comment-16344003 ] genericqa commented on HADOOP-15170: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15006) Encrypt S3A data client-side with Hadoop libraries & Hadoop KMS

2018-01-29 Thread Steve Moist (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343975#comment-16343975 ] Steve Moist commented on HADOOP-15006: -- >what's your proposal for letting the client encryption be

[jira] [Commented] (HADOOP-15129) Datanode caches namenode DNS lookup failure and cannot startup

2018-01-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343948#comment-16343948 ] Arpit Agarwal commented on HADOOP-15129: I haven't looked at the test cases yet but the change

[jira] [Commented] (HADOOP-12897) KerberosAuthenticator.authenticate to include URL on IO failures

2018-01-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343884#comment-16343884 ] Arpit Agarwal commented on HADOOP-12897: Minor comment. You can simplify the following code:

[jira] [Commented] (HADOOP-15168) Add kdiag tool to hadoop command

2018-01-29 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343880#comment-16343880 ] Hanisha Koneru commented on HADOOP-15168: - {quote}I think, the commands which are related to

[jira] [Commented] (HADOOP-15170) Add symlink support to FileUtil#unTarUsingJava

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343828#comment-16343828 ] Ajay Kumar commented on HADOOP-15170: - [~jlowe], thanks for review. Updated patch v3 with suggested

[jira] [Updated] (HADOOP-15170) Add symlink support to FileUtil#unTarUsingJava

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15170: Attachment: HADOOP-15170.003.patch > Add symlink support to FileUtil#unTarUsingJava >

[jira] [Commented] (HADOOP-14671) Upgrade to Apache Yetus 0.7.0

2018-01-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343778#comment-16343778 ] Allen Wittenauer commented on HADOOP-14671: --- YETUS-609 is pretty much a blocker for Hadoop to

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2018-01-29 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343754#comment-16343754 ] Daryn Sharp commented on HADOOP-14445: -- This fell off my radar. Quick recap since conversation has

[jira] [Commented] (HADOOP-15186) Allow Azure Data Lake SDK dependency version to be set on the command line

2018-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343733#comment-16343733 ] Hudson commented on HADOOP-15186: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13577 (See

[jira] [Commented] (HADOOP-14969) Improve diagnostics in secure DataNode startup

2018-01-29 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343727#comment-16343727 ] Ajay Kumar commented on HADOOP-14969: - Failed test is unrelated, passes locally. > Improve

[jira] [Comment Edited] (HADOOP-15006) Encrypt S3A data client-side with Hadoop libraries & Hadoop KMS

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342920#comment-16342920 ] Steve Loughran edited comment on HADOOP-15006 at 1/29/18 5:49 PM: -- I'm

[jira] [Updated] (HADOOP-15186) Allow Azure Data Lake SDK dependency version to be set on the command line

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15186: Resolution: Fixed Fix Version/s: 3.0.1 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-15186) Allow Azure Data Lake SDK dependency version to be set on the command line

2018-01-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15186: Summary: Allow Azure Data Lake SDK dependency version to be set on the command line

[jira] [Commented] (HADOOP-14671) Upgrade to Apache Yetus 0.7.0

2018-01-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343554#comment-16343554 ] Allen Wittenauer commented on HADOOP-14671: --- 0.7.0 was released today. It includes a lot of

[jira] [Updated] (HADOOP-14671) Upgrade to Apache Yetus 0.7.0

2018-01-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-14671: -- Description: Apache Yetus 0.7.0 was released. Let's upgrade the bundled reference to

[jira] [Updated] (HADOOP-14671) Upgrade to Apache Yetus 0.7.0

2018-01-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HADOOP-14671: -- Summary: Upgrade to Apache Yetus 0.7.0 (was: Upgrade to Apache Yetus 0.5.1) >

[jira] [Commented] (HADOOP-15151) MapFile.fix creates a wrong index file in case of block-compressed data file.

2018-01-29 Thread Grigori Rybkine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343324#comment-16343324 ] Grigori Rybkine commented on HADOOP-15151: -- Thank you very much for the comment about the

[jira] [Commented] (HADOOP-15151) MapFile.fix creates a wrong index file in case of block-compressed data file.

2018-01-29 Thread Grigori Rybkine (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343316#comment-16343316 ] Grigori Rybkine commented on HADOOP-15151: -- Thank you, [~chris.douglas], very much for