[GitHub] [hadoop] mustafaiman commented on a change in pull request #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are…

2020-01-24 Thread GitBox
mustafaiman commented on a change in pull request #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815#discussion_r370831954 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard

[GitHub] [hadoop] bgaborg commented on a change in pull request #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are…

2020-01-24 Thread GitBox
bgaborg commented on a change in pull request #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815#discussion_r370826396 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/S3G

[jira] [Commented] (HADOOP-16827) TestHarFileSystem.testInheritedMethodsImplemented broken

2020-01-24 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023180#comment-17023180 ] Hudson commented on HADOOP-16827: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Resolved] (HADOOP-16827) TestHarFileSystem.testInheritedMethodsImplemented broken

2020-01-24 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-16827. Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed > TestHarFileSy

[GitHub] [hadoop] liuml07 merged pull request #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken.

2020-01-24 Thread GitBox
liuml07 merged pull request #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken. URL: https://github.com/apache/hadoop/pull/1817 This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] mustafaiman commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-24 Thread GitBox
mustafaiman commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-578231504 @steveloughran @bgaborg thank you for reviews. This is an

[jira] [Commented] (HADOOP-16683) Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException

2020-01-24 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023120#comment-17023120 ] Kihwal Lee commented on HADOOP-16683: - Picked to branch-2.10. > Disable retry of F

[jira] [Commented] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2020-01-24 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023119#comment-17023119 ] Kihwal Lee commented on HADOOP-16580: - Picked to branch-2.10. > Disable retry of F

[jira] [Updated] (HADOOP-16580) Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException

2020-01-24 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-16580: Fix Version/s: 2.10.1 > Disable retry of FailoverOnNetworkExceptionRetry in case of > AccessCont

[jira] [Updated] (HADOOP-16683) Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException

2020-01-24 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HADOOP-16683: Fix Version/s: 2.10.1 > Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped > Ac

[GitHub] [hadoop] hadoop-yetus commented on issue #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken.

2020-01-24 Thread GitBox
hadoop-yetus commented on issue #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken. URL: https://github.com/apache/hadoop/pull/1817#issuecomment-578205541 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::

[jira] [Commented] (HADOOP-15990) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

2020-01-24 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023069#comment-17023069 ] Hadoop QA commented on HADOOP-15990: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Commented] (HADOOP-15990) S3AFileSystem.verifyBucketExists to move to s3.doesBucketExistV2

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023060#comment-17023060 ] Steve Loughran commented on HADOOP-15990: - proposing merging this in with HADOO

[jira] [Updated] (HADOOP-16711) Add way to skip "verifyBuckets" check in S3A fs init()

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16711: Affects Version/s: 3.2.1 > Add way to skip "verifyBuckets" check in S3A fs init() > -

[jira] [Assigned] (HADOOP-16711) Add way to skip "verifyBuckets" check in S3A fs init()

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16711: --- Assignee: Rajesh Balamohan > Add way to skip "verifyBuckets" check in S3A fs init(

[GitHub] [hadoop] steveloughran commented on issue #1812: HADOOP-13223: remove need for winutils.exe

2020-01-24 Thread GitBox
steveloughran commented on issue #1812: HADOOP-13223: remove need for winutils.exe URL: https://github.com/apache/hadoop/pull/1812#issuecomment-578195407 @wintsonpryme somehow this PR is including everyone else's work. Please create a PR against trunk, with only your changes. Closing

[GitHub] [hadoop] steveloughran closed pull request #1812: HADOOP-13223: remove need for winutils.exe

2020-01-24 Thread GitBox
steveloughran closed pull request #1812: HADOOP-13223: remove need for winutils.exe URL: https://github.com/apache/hadoop/pull/1812 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (HADOOP-16711) With S3Guard + authmode, consider skipping "verifyBuckets" check in S3A fs init()

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023042#comment-17023042 ] Steve Loughran commented on HADOOP-16711: - * I'm still waiting for the declarat

[jira] [Updated] (HADOOP-16711) Add way to skip "verifyBuckets" check in S3A fs init()

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16711: Summary: Add way to skip "verifyBuckets" check in S3A fs init() (was: With S3Guard + aut

[GitHub] [hadoop] steveloughran commented on issue #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken.

2020-01-24 Thread GitBox
steveloughran commented on issue #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken. URL: https://github.com/apache/hadoop/pull/1817#issuecomment-578159196 caused by #1761 @liuml07 once Yetus is happy, could you review this? --

[GitHub] [hadoop] steveloughran opened a new pull request #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken.

2020-01-24 Thread GitBox
steveloughran opened a new pull request #1817: HADOOP-16827. TestHarFileSystem.testInheritedMethodsImplemented broken. URL: https://github.com/apache/hadoop/pull/1817 This is a regression caused by HADOOP-16759. The test TestHarFileSystem uses introspection to verify that HarFileSyst

[jira] [Commented] (HADOOP-16827) TestHarFileSystem.testInheritedMethodsImplemented broken

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022981#comment-17022981 ] Steve Loughran commented on HADOOP-16827: - {code:java} {code} > TestHarFileSy

[jira] [Comment Edited] (HADOOP-16827) TestHarFileSystem.testInheritedMethodsImplemented broken

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022981#comment-17022981 ] Steve Loughran edited comment on HADOOP-16827 at 1/24/20 2:31 PM: ---

[jira] [Created] (HADOOP-16827) TestHarFileSystem.testInheritedMethodsImplemented broken

2020-01-24 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16827: --- Summary: TestHarFileSystem.testInheritedMethodsImplemented broken Key: HADOOP-16827 URL: https://issues.apache.org/jira/browse/HADOOP-16827 Project: Hadoop Commo

[jira] [Commented] (HADOOP-16792) Let s3 clients configure request timeout

2020-01-24 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022960#comment-17022960 ] Hudson commented on HADOOP-16792: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Updated] (HADOOP-16792) Let s3 clients configure request timeout

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16792: Fix Version/s: 3.3.0 Resolution: Fixed Status: Resolved (was: Patch Ava

[jira] [Commented] (HADOOP-16792) Let s3 clients configure request timeout

2020-01-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022944#comment-17022944 ] Steve Loughran commented on HADOOP-16792: - committed to trunk h2. Mustafa's sc

[GitHub] [hadoop] steveloughran closed pull request #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-24 Thread GitBox
steveloughran closed pull request #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795 This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [hadoop] steveloughran commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-24 Thread GitBox
steveloughran commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-578134555 test failure unrelated; +1 committed to trunk with the warning text in the commit message. I don't want to

[GitHub] [hadoop] steveloughran commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-24 Thread GitBox
steveloughran commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-578131108 test failure looks like a regression of mine -should have been picked up earlier..interesting --

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-24 Thread GitBox
hadoop-yetus removed a comment on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-577943862 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] hadoop-yetus commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable

2020-01-24 Thread GitBox
hadoop-yetus commented on issue #1795: HADOOP-16792: Make S3 client request timeout configurable URL: https://github.com/apache/hadoop/pull/1795#issuecomment-578066389 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|--

[GitHub] [hadoop] hadoop-yetus commented on issue #1816: HDFS-10648. Expose Balancer metrics through Metrics2.

2020-01-24 Thread GitBox
hadoop-yetus commented on issue #1816: HDFS-10648. Expose Balancer metrics through Metrics2. URL: https://github.com/apache/hadoop/pull/1816#issuecomment-578058906 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|--

[GitHub] [hadoop] hadoop-yetus commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are…

2020-01-24 Thread GitBox
hadoop-yetus commented on issue #1815: HADOOP-16801: S3Guard-listFiles will not query s3 if all listings are… URL: https://github.com/apache/hadoop/pull/1815#issuecomment-578046559 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|