[GitHub] [hadoop] hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move et

2020-02-10 Thread GitBox
hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-584480385 :broken_heart: **-1 overall**

[jira] [Created] (HADOOP-16850) Support getting thread info from thread group for JvmMetrics to improve the performance

2020-02-10 Thread Tao Yang (Jira)
Tao Yang created HADOOP-16850: - Summary: Support getting thread info from thread group for JvmMetrics to improve the performance Key: HADOOP-16850 URL: https://issues.apache.org/jira/browse/HADOOP-16850

[GitHub] [hadoop] hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move et

2020-02-10 Thread GitBox
hadoop-yetus commented on issue #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#issuecomment-584453114 :broken_heart: **-1 overall**

[GitHub] [hadoop] hadoop-yetus commented on issue #1826: HADOOP-16823. Large DeleteObject requests are their own Thundering Herd

2020-02-10 Thread GitBox
hadoop-yetus commented on issue #1826: HADOOP-16823. Large DeleteObject requests are their own Thundering Herd URL: https://github.com/apache/hadoop/pull/1826#issuecomment-584323280 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation

2020-02-10 Thread GitBox
hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation URL: https://github.com/apache/hadoop/pull/1823#issuecomment-581467919 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation

2020-02-10 Thread GitBox
hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation URL: https://github.com/apache/hadoop/pull/1823#issuecomment-581439423 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation

2020-02-10 Thread GitBox
hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation URL: https://github.com/apache/hadoop/pull/1823#issuecomment-580732492 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] hadoop-yetus commented on issue #1826: HADOOP-16823. Large DeleteObject requests are their own Thundering Herd

2020-02-10 Thread GitBox
hadoop-yetus commented on issue #1826: HADOOP-16823. Large DeleteObject requests are their own Thundering Herd URL: https://github.com/apache/hadoop/pull/1826#issuecomment-584280267 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1836: HADOOP-16646. Backport S3A enhancements and fixes from trunk to branch-3.2

2020-02-10 Thread GitBox
hadoop-yetus removed a comment on issue #1836: HADOOP-16646. Backport S3A enhancements and fixes from trunk to branch-3.2 URL: https://github.com/apache/hadoop/pull/1836#issuecomment-583596821 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment

[GitHub] [hadoop] goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to the Router

2020-02-10 Thread GitBox
goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to the Router URL: https://github.com/apache/hadoop/pull/1832#discussion_r377216849 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to the Router

2020-02-10 Thread GitBox
goiri commented on a change in pull request #1832: HDFS-13989. RBF: Add FSCK to the Router URL: https://github.com/apache/hadoop/pull/1832#discussion_r377217468 ## File path:

[jira] [Updated] (HADOOP-16732) S3Guard to support encrypted DynamoDB table

2020-02-10 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-16732: --- Release Note: Support server-side encrypted DynamoDB table for S3Guard. Users don't need

[jira] [Updated] (HADOOP-16823) Large DeleteObject requests are their own Thundering Herd

2020-02-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16823: Release Note: The page size for bulk delete operations has been reduced from 1000 to 250

[jira] [Updated] (HADOOP-16823) Large DeleteObject requests are their own Thundering Herd

2020-02-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16823: Summary: Large DeleteObject requests are their own Thundering Herd (was: Manage S3

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1826: HADOOP-16823. Improve S3A Throttling in S3Guard and S3 bulk delete operations

2020-02-10 Thread GitBox
hadoop-yetus removed a comment on issue #1826: HADOOP-16823. Improve S3A Throttling in S3Guard and S3 bulk delete operations URL: https://github.com/apache/hadoop/pull/1826#issuecomment-582521724 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[jira] [Commented] (HADOOP-13811) s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to sanitize XML document destined for handler class

2020-02-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033751#comment-17033751 ] Steve Loughran commented on HADOOP-13811: - HADOOP-16823 shows we get this under load of large

[GitHub] [hadoop] steveloughran commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
steveloughran commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#issuecomment-584220746 (retested against s3 ireland, got the failure in

[GitHub] [hadoop] steveloughran commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
steveloughran commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#issuecomment-584219900 Gabor, thanks for the review. yeah, you are right. Improvement. Before I merge, do you want to look at

[GitHub] [hadoop] steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#discussion_r377178960 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#discussion_r377181855 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#discussion_r377181603 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#discussion_r377178960 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377166880 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377170722 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377164858 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377168238 ## File path:

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
hadoop-yetus removed a comment on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-583830785 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377172646 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377170084 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377169124 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377169421 ## File path:

[GitHub] [hadoop] steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
steveloughran commented on a change in pull request #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#discussion_r377173220 ## File path:

[GitHub] [hadoop] bgaborg commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
bgaborg commented on issue #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#issuecomment-584100455 (also this is not a bug imho, more like an improvement)

[GitHub] [hadoop] bgaborg commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
bgaborg commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#discussion_r377018136 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java

[GitHub] [hadoop] bgaborg commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client.

2020-02-10 Thread GitBox
bgaborg commented on a change in pull request #1826: HADOOP-16823. Manage S3 Throttling exclusively in S3A client. URL: https://github.com/apache/hadoop/pull/1826#discussion_r377019280 ## File path:

[jira] [Created] (HADOOP-16849) start-build-env.sh behaves incorrectly when username is numeric only

2020-02-10 Thread Jihyun Cho (Jira)
Jihyun Cho created HADOOP-16849: --- Summary: start-build-env.sh behaves incorrectly when username is numeric only Key: HADOOP-16849 URL: https://issues.apache.org/jira/browse/HADOOP-16849 Project: Hadoop

[GitHub] [hadoop] hadoop-yetus commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init()

2020-02-10 Thread GitBox
hadoop-yetus commented on issue #1838: HADOOP-16711 Add way to skip verifyBuckets check in S3A fs init() URL: https://github.com/apache/hadoop/pull/1838#issuecomment-584032513 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus commented on issue #1832: HDFS-13989. RBF: Add FSCK to the Router

2020-02-10 Thread GitBox
hadoop-yetus commented on issue #1832: HDFS-13989. RBF: Add FSCK to the Router URL: https://github.com/apache/hadoop/pull/1832#issuecomment-584002175 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:|