[jira] [Comment Edited] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

2018-03-28 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418505#comment-16418505 ] Genmao Yu edited comment on HADOOP-14999 at 3/29/18 6:40 AM: -

[jira] [Commented] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

2018-03-28 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418505#comment-16418505 ] Genmao Yu commented on HADOOP-14999: [~Sammi] - #2: {{根据不同的上传方式,对象的大小限制是不一样的。分片上传 最

[jira] [Assigned] (HADOOP-15350) Update maven plugin tools to fix compile error in hadoop-maven-plugins module

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15350: --- Assignee: Takanobu Asanuma (was: Gabor Bota) > Update maven plugin tools to fix compile er

[jira] [Assigned] (HADOOP-15350) Update maven plugin tools to fix compile error in hadoop-maven-plugins module

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-15350: --- Assignee: Gabor Bota (was: Takanobu Asanuma) > Update maven plugin tools to fix compile er

[jira] [Assigned] (HADOOP-15350) Update maven plugin tools to fix compile error in hadoop-maven-plugins module

2018-03-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma reassigned HADOOP-15350: - Assignee: Takanobu Asanuma > Update maven plugin tools to fix compile error in

[jira] [Commented] (HADOOP-15350) Update maven plugin tools to fix compile error in hadoop-maven-plugins module

2018-03-28 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418364#comment-16418364 ] Takanobu Asanuma commented on HADOOP-15350: --- Thanks for catching the issue. I'

[jira] [Comment Edited] (HADOOP-15317) Improve NetworkTopology chooseRandom's loop

2018-03-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418341#comment-16418341 ] Ajay Kumar edited comment on HADOOP-15317 at 3/29/18 2:44 AM:

[jira] [Comment Edited] (HADOOP-15317) Improve NetworkTopology chooseRandom's loop

2018-03-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418341#comment-16418341 ] Ajay Kumar edited comment on HADOOP-15317 at 3/29/18 2:43 AM:

[jira] [Comment Edited] (HADOOP-15317) Improve NetworkTopology chooseRandom's loop

2018-03-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418341#comment-16418341 ] Ajay Kumar edited comment on HADOOP-15317 at 3/29/18 2:36 AM:

[jira] [Commented] (HADOOP-15317) Improve NetworkTopology chooseRandom's loop

2018-03-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418341#comment-16418341 ] Ajay Kumar commented on HADOOP-15317: - [~xiaochen], patch v5 looks good. One questio

[jira] [Updated] (HADOOP-15317) Improve NetworkTopology chooseRandom's loop

2018-03-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HADOOP-15317: Attachment: Screen Shot 2018-03-28 at 7.23.32 PM.png > Improve NetworkTopology chooseRandom's loop

[jira] [Commented] (HADOOP-15312) Undocumented KeyProvider configuration keys

2018-03-28 Thread LiXin Ge (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418295#comment-16418295 ] LiXin Ge commented on HADOOP-15312: --- [~jojochuang] Thanks for finding,reviewing and co

[jira] [Commented] (HADOOP-15304) [JDK10] Migrate from com.sun.tools.doclets to the replacement

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418212#comment-16418212 ] genericqa commented on HADOOP-15304: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-15336) RBF: NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418201#comment-16418201 ] Íñigo Goiri commented on HADOOP-15336: -- Thanks [~shahrs87] for your comments. The r

[jira] [Updated] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HADOOP-15336: - Summary: NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2

[jira] [Created] (HADOOP-15351) Deprecate all existing password fields in hadoop configuration

2018-03-28 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HADOOP-15351: Summary: Deprecate all existing password fields in hadoop configuration Key: HADOOP-15351 URL: https://issues.apache.org/jira/browse/HADOOP-15351 Project: Had

[jira] [Updated] (HADOOP-15336) RBF: NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HADOOP-15336: - Description: KeyProviderUri is not available in 2.7 so when 2.7 clients contact with 3.2 service

[jira] [Updated] (HADOOP-15325) Make Configuration#getPasswordFromCredentialsProvider() a public API

2018-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-15325: - Summary: Make Configuration#getPasswordFromCredentialsProvider() a public API (was: Add

[jira] [Commented] (HADOOP-15325) Add an option to make Configuration.getPassword() not to fallback to read passwords from configuration.

2018-03-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418190#comment-16418190 ] Wei-Chiu Chuang commented on HADOOP-15325: -- +1 to make getPasswordFromCredentia

[jira] [Commented] (HADOOP-15336) RBF: NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418151#comment-16418151 ] genericqa commented on HADOOP-15336: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HADOOP-15336) RBF: NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HADOOP-15336: Summary: RBF: NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communicatio

[jira] [Commented] (HADOOP-15350) Update maven plugin tools to fix compile error in hadoop-maven-plugins module

2018-03-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418091#comment-16418091 ] Akira Ajisaka commented on HADOOP-15350: Full stack trace with -X option: {nofor

[jira] [Updated] (HADOOP-11423) [Umbrella] Fix Java 10 incompatibilities in Hadoop

2018-03-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-11423: --- Priority: Major (was: Minor) > [Umbrella] Fix Java 10 incompatibilities in Hadoop > ---

[jira] [Created] (HADOOP-15350) Update maven plugin tools to fix compile error in hadoop-maven-plugins module

2018-03-28 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HADOOP-15350: -- Summary: Update maven plugin tools to fix compile error in hadoop-maven-plugins module Key: HADOOP-15350 URL: https://issues.apache.org/jira/browse/HADOOP-15350 P

[jira] [Updated] (HADOOP-15304) [JDK10] Migrate from com.sun.tools.doclets to the replacement

2018-03-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15304: --- Assignee: Akira Ajisaka Target Version/s: 3.2.0 Status: Patch Avail

[jira] [Updated] (HADOOP-15304) [JDK10] Migrate from com.sun.tools.doclets to the replacement

2018-03-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15304: --- Attachment: HADOOP-15304.01.patch > [JDK10] Migrate from com.sun.tools.doclets to the replac

[jira] [Commented] (HADOOP-15304) [JDK10] Migrate from com.sun.tools.doclets to the replacement

2018-03-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418072#comment-16418072 ] Akira Ajisaka commented on HADOOP-15304: I'd like to simply exclude this package

[jira] [Commented] (HADOOP-15304) [JDK10] Migrate from com.sun.tools.doclets to the replacement

2018-03-28 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418049#comment-16418049 ] Akira Ajisaka commented on HADOOP-15304: The old doclet API is used by o.a.h.cla

[jira] [Commented] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418039#comment-16418039 ] Rushabh S Shah commented on HADOOP-15336: - Thanks [~zhengxg3] for the stack trac

[jira] [Commented] (HADOOP-15320) Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake

2018-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417979#comment-16417979 ] Hudson commented on HADOOP-15320: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Com

[jira] [Commented] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417961#comment-16417961 ] genericqa commented on HADOOP-15336: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HADOOP-14758) S3GuardTool.prune to handle UnsupportedOperationException

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417953#comment-16417953 ] Steve Loughran commented on HADOOP-14758: - LGTM. as you've done with your other

[jira] [Updated] (HADOOP-15320) Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake

2018-03-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-15320: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.1

[jira] [Updated] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HADOOP-15336: Status: Patch Available (was: Open) > NPE for FsServerDefaults.getKeyProviderUri() for cl

[jira] [Updated] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HADOOP-15336: Attachment: HADOOP-15336.001.patch > NPE for FsServerDefaults.getKeyProviderUri() for clie

[jira] [Updated] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HADOOP-15336: Status: Open (was: Patch Available) > NPE for FsServerDefaults.getKeyProviderUri() for cl

[jira] [Updated] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HADOOP-15336: Status: Patch Available (was: In Progress) > NPE for FsServerDefaults.getKeyProviderUri()

[jira] [Updated] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sherwood Zheng updated HADOOP-15336: Attachment: HADOOP-15336.000.patch > NPE for FsServerDefaults.getKeyProviderUri() for clie

[jira] [Commented] (HADOOP-15336) NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.2

2018-03-28 Thread Sherwood Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417812#comment-16417812 ] Sherwood Zheng commented on HADOOP-15336: - The problem happens when I was testin

[jira] [Updated] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HADOOP-15345: - Affects Version/s: (was: 2.7.6) 2.7.5 > Backport HADOOP-12185 to bran

[jira] [Assigned] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned HADOOP-15345: Assignee: He Xiaoqiao > Backport HADOOP-12185 to branch-2.7: NetworkTopology is not effic

[jira] [Updated] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HADOOP-15345: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.6 Status: Reso

[jira] [Commented] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417755#comment-16417755 ] Íñigo Goiri commented on HADOOP-15345: -- [^HADOOP-15345-branch-2.7.001.patch] alread

[jira] [Commented] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread JIRA
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417744#comment-16417744 ] Íñigo Goiri commented on HADOOP-15345: -- +1. Let me try to commit the attached patch

[jira] [Commented] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417685#comment-16417685 ] genericqa commented on HADOOP-14759: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Updated] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14759: Status: Patch Available (was: Open) > S3GuardTool prune to prune specific bucket entries > --

[jira] [Updated] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14759: Attachment: HADOOP-14759.005.patch > S3GuardTool prune to prune specific bucket entries >

[jira] [Updated] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HADOOP-14759: Status: Open (was: Patch Available) > S3GuardTool prune to prune specific bucket entries > --

[jira] [Commented] (HADOOP-14758) S3GuardTool.prune to handle UnsupportedOperationException

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417494#comment-16417494 ] Gabor Bota commented on HADOOP-14758: - I think it would be better to solve this with

[jira] [Commented] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417465#comment-16417465 ] Gabor Bota commented on HADOOP-14759: - I was not aware that this is a valid usage. I

[jira] [Commented] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417384#comment-16417384 ] Rushabh S Shah commented on HADOOP-15345: - bq. And the conflict part is all abou

[jira] [Comment Edited] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417379#comment-16417379 ] He Xiaoqiao edited comment on HADOOP-15345 at 3/28/18 2:08 PM: ---

[jira] [Commented] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417382#comment-16417382 ] Rushabh S Shah commented on HADOOP-15345: - bq. I have resolved the conflict afte

[jira] [Commented] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417379#comment-16417379 ] He Xiaoqiao commented on HADOOP-15345: -- Thanks [~shahrs87] for your review. I have

[jira] [Commented] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417351#comment-16417351 ] Sean Mackrory commented on HADOOP-14759: The command as I wrote it above (bin/ha

[jira] [Commented] (HADOOP-15345) Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes

2018-03-28 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417335#comment-16417335 ] Rushabh S Shah commented on HADOOP-15345: - [~hexiaoqiao]: thanks for the patch.

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417233#comment-16417233 ] Steve Loughran commented on HADOOP-15349: - Theres ~50 files being committed; eac

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417229#comment-16417229 ] Steve Loughran commented on HADOOP-15349: - +metrics. The S3Guard retries are not

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417224#comment-16417224 ] Steve Loughran commented on HADOOP-15349: - Attached full log # no meaningful de

[jira] [Updated] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15349: Priority: Major (was: Minor) > S3Guard DDB retryBackoff to be more informative on limits

[jira] [Updated] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15349: Attachment: failure.log > S3Guard DDB retryBackoff to be more informative on limits exceed

[jira] [Created] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15349: --- Summary: S3Guard DDB retryBackoff to be more informative on limits exceeded Key: HADOOP-15349 URL: https://issues.apache.org/jira/browse/HADOOP-15349 Project: H

[jira] [Commented] (HADOOP-15349) S3Guard DDB retryBackoff to be more informative on limits exceeded

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417219#comment-16417219 ] Steve Loughran commented on HADOOP-15349: - Stack {code} 2018-03-28 04:22:17,375

[jira] [Commented] (HADOOP-15347) S3ARetryPolicy to handle AWS 500 responses/error code TooBusyException with the throttle backoff policy

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417143#comment-16417143 ] Steve Loughran commented on HADOOP-15347: - # do it for "TooBusyException" error

[jira] [Updated] (HADOOP-15347) S3ARetryPolicy to handle AWS 500 responses/error code TooBusyException with the throttle backoff policy

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15347: Summary: S3ARetryPolicy to handle AWS 500 responses/error code TooBusyException with the t

[jira] [Commented] (HADOOP-14758) S3GuardTool.prune to handle UnsupportedOperationException

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417141#comment-16417141 ] Steve Loughran commented on HADOOP-14758: - wrong link. Deleted it. > S3GuardToo

[jira] [Commented] (HADOOP-15320) Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417139#comment-16417139 ] Steve Loughran commented on HADOOP-15320: - If you are happy, I am +1 > Remove

[jira] [Commented] (HADOOP-15317) Improve NetworkTopology chooseRandom's loop

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417108#comment-16417108 ] genericqa commented on HADOOP-15317: | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Resolved] (HADOOP-14717) Add StreamCapabilities support to s3a

2018-03-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14717. - Resolution: Duplicate Assignee: Steve Loughran (was: Sean Mackrory) Fix

[jira] [Comment Edited] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417045#comment-16417045 ] Gabor Bota edited comment on HADOOP-14759 at 3/28/18 8:45 AM:

[jira] [Commented] (HADOOP-14759) S3GuardTool prune to prune specific bucket entries

2018-03-28 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417045#comment-16417045 ] Gabor Bota commented on HADOOP-14759: - Thanks for the review [~mackrorysd]! I think