[GitHub] [hadoop] mukund-thakur commented on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation

2020-03-02 Thread GitBox
mukund-thakur commented on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation URL: https://github.com/apache/hadoop/pull/1823#issuecomment-593810970 Thanks @steveloughran. This is an

[jira] [Comment Edited] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-03-02 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049957#comment-17049957 ] Fengnan Li edited comment on HADOOP-16828 at 3/3/20 7:00 AM:

[jira] [Commented] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-03-02 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049957#comment-17049957 ] Fengnan Li commented on HADOOP-16828: - [~xyao] Thanks very much for the review! Rea

[jira] [Updated] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-03-02 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fengnan Li updated HADOOP-16828: Attachment: HADOOP-16828.002.patch > Zookeeper Delegation Token Manager fetch sequence number by

[jira] [Commented] (HADOOP-16890) ABFS: Change in expiry calculation for MSI token provider

2020-03-02 Thread Bilahari T H (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049937#comment-17049937 ] Bilahari T H commented on HADOOP-16890: --- Driver test results using a Namespace en

[jira] [Commented] (HADOOP-16840) AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket

2020-03-02 Thread Weiwei Yang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049907#comment-17049907 ] Weiwei Yang commented on HADOOP-16840: -- Hi [~wujinhu] Sorry for the late response

[GitHub] [hadoop] invincible-akshay commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity.

2020-03-02 Thread GitBox
invincible-akshay commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity. URL: https://github.com/apache/hadoop/pull/1871#issuecomment-593759072 Should we also update the following: > With this policy, the replicas of a file do not evenly distribute across

[GitHub] [hadoop] aajisaka commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity.

2020-03-02 Thread GitBox
aajisaka commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity. URL: https://github.com/apache/hadoop/pull/1871#issuecomment-593753554 Thanks. > Or is it appropriate to update the code in same branch and let the PR get updated automatically? This is my fir

[jira] [Commented] (HADOOP-16899) Update HdfsDesign.md to reduce ambiguity

2020-03-02 Thread Akshay Nehe (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049868#comment-17049868 ] Akshay Nehe commented on HADOOP-16899: -- Based on comment by [~aajisaka] on the PR,

[GitHub] [hadoop] invincible-akshay commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity.

2020-03-02 Thread GitBox
invincible-akshay commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity. URL: https://github.com/apache/hadoop/pull/1871#issuecomment-593747194 Hi @aajisaka , thank you for your feedback. I agree with you, talk about fractions made me think about multiple blocks

[GitHub] [hadoop] aajisaka commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity.

2020-03-02 Thread GitBox
aajisaka commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity. URL: https://github.com/apache/hadoop/pull/1871#issuecomment-593742741 Thank you for your contribution. The sentence seems still ambiguous to me > One third of replicas are on one node,

[GitHub] [hadoop] mukul1987 commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
mukul1987 commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#discussion_r386768106 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapsh

[jira] [Commented] (HADOOP-16898) Batch listing of multiple directories to be an unstable interface

2020-03-02 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049829#comment-17049829 ] Wei-Chiu Chuang commented on HADOOP-16898: -- [~csun] fyi > Batch listing of mu

[GitHub] [hadoop] jojochuang commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
jojochuang commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#issuecomment-593719088 I've gone through all the usage of the snapshot id. The only concern i had was bitwise operations on the snapshot id, but i didn't

[GitHub] [hadoop] jojochuang commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
jojochuang commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#discussion_r386750242 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/snaps

[GitHub] [hadoop] jojochuang commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
jojochuang commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#issuecomment-593718653 @karthikhw can you double check the failed tests? especially the snapshot tests.

[GitHub] [hadoop] hadoop-yetus commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#issuecomment-593714119 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|

[GitHub] [hadoop] hadoop-yetus commented on issue #1872: Hadoop 16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1872: Hadoop 16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1872#issuecomment-593699941 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] hadoop-yetus commented on issue #1872: Hadoop 16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1872: Hadoop 16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1872#issuecomment-593691330 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] jojochuang opened a new pull request #1873: YARN-7307. Allow client/AM update supported resource types via YARN APIs. (Sunil G via wangda)

2020-03-02 Thread GitBox
jojochuang opened a new pull request #1873: YARN-7307. Allow client/AM update supported resource types via YARN APIs. (Sunil G via wangda) URL: https://github.com/apache/hadoop/pull/1873 (cherry picked from commit 170b6a48c4221d85faa0a53c4d632c5a04a2569c) Change-Id: I0e3190a4a674ceb03be7

[GitHub] [hadoop] bilaharith opened a new pull request #1872: Hadoop 16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
bilaharith opened a new pull request #1872: Hadoop 16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1872 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull reque

[GitHub] [hadoop] karthikhw commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
karthikhw commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#issuecomment-593652779 Submitted new PR with the changes requested. This is an automated

[jira] [Updated] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-02 Thread Andrew Olson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-16900: -- Description: If a written file size exceeds 10,000 * {{fs.s3a.multipart.size}}, a corrupt tru

[jira] [Created] (HADOOP-16900) Very large files can be truncated when written through S3AFileSystem

2020-03-02 Thread Andrew Olson (Jira)
Andrew Olson created HADOOP-16900: - Summary: Very large files can be truncated when written through S3AFileSystem Key: HADOOP-16900 URL: https://issues.apache.org/jira/browse/HADOOP-16900 Project: Had

[GitHub] [hadoop] karthikhw commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
karthikhw commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#discussion_r386677308 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapsh

[GitHub] [hadoop] hadoop-yetus commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity.

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1871: Hadoop-16899. Update HdfsDesign.md to reduce ambiguity. URL: https://github.com/apache/hadoop/pull/1871#issuecomment-593644340 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|---

[GitHub] [hadoop] hadoop-yetus commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#issuecomment-593644106 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|

[GitHub] [hadoop] hadoop-yetus commented on issue #1839: HADOOP-16848. Refactoring: initial layering

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1839: HADOOP-16848. Refactoring: initial layering URL: https://github.com/apache/hadoop/pull/1839#issuecomment-593629160 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:-

[GitHub] [hadoop] hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1820: HADOOP-16830. Add public IOStatistics API + S3A implementation URL: https://github.com/apache/hadoop/pull/1820#issuecomment-593628155 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|-

[GitHub] [hadoop] invincible-akshay commented on issue #1871: Update HdfsDesign.md

2020-03-02 Thread GitBox
invincible-akshay commented on issue #1871: Update HdfsDesign.md URL: https://github.com/apache/hadoop/pull/1871#issuecomment-593617851 Re-opened on creating JIRA. This is an automated message from the Apache Git Service. To r

[GitHub] [hadoop] invincible-akshay opened a new pull request #1871: Update HdfsDesign.md

2020-03-02 Thread GitBox
invincible-akshay opened a new pull request #1871: Update HdfsDesign.md URL: https://github.com/apache/hadoop/pull/1871 Proposed change is in 2nd last sentence of the affected paragraph. Considering the statement segmented in 3 parts by the commas: 1. the first part talks about "one t

[jira] [Updated] (HADOOP-16899) Update HdfsDesign.md to reduce ambiguity

2020-03-02 Thread Akshay Nehe (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akshay Nehe updated HADOOP-16899: - Description: A proposed update to [https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-pro

[jira] [Created] (HADOOP-16899) Update HdfsDesign.md to reduce ambiguity

2020-03-02 Thread Akshay Nehe (Jira)
Akshay Nehe created HADOOP-16899: Summary: Update HdfsDesign.md to reduce ambiguity Key: HADOOP-16899 URL: https://issues.apache.org/jira/browse/HADOOP-16899 Project: Hadoop Common Issue Type

[GitHub] [hadoop] invincible-akshay commented on issue #1871: Update HdfsDesign.md

2020-03-02 Thread GitBox
invincible-akshay commented on issue #1871: Update HdfsDesign.md URL: https://github.com/apache/hadoop/pull/1871#issuecomment-593597372 Closing because the procedure to raise a JIRA before pull request wasn't followed, will raise again with right steps.

[GitHub] [hadoop] invincible-akshay closed pull request #1871: Update HdfsDesign.md

2020-03-02 Thread GitBox
invincible-akshay closed pull request #1871: Update HdfsDesign.md URL: https://github.com/apache/hadoop/pull/1871 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [hadoop] arp7 commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
arp7 commented on a change in pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870#discussion_r386626461 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/snapshot/Sn

[GitHub] [hadoop] invincible-akshay opened a new pull request #1871: Update HdfsDesign.md

2020-03-02 Thread GitBox
invincible-akshay opened a new pull request #1871: Update HdfsDesign.md URL: https://github.com/apache/hadoop/pull/1871 Proposed change is in 2nd last sentence of the affected paragraph. Considering the statement segmented in 3 parts by the commas: 1. the first part talks about "one t

[jira] [Commented] (HADOOP-16890) ABFS: Change in expiry calculation for MSI token provider

2020-03-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049610#comment-17049610 ] Hadoop QA commented on HADOOP-16890: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1866#issuecomment-593593848 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[GitHub] [hadoop] hadoop-yetus commented on issue #1869: HADOOP-16898. Batch listing of multiple directories to be an unstable interface

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1869: HADOOP-16898. Batch listing of multiple directories to be an unstable interface URL: https://github.com/apache/hadoop/pull/1869#issuecomment-593584429 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[jira] [Commented] (HADOOP-16828) Zookeeper Delegation Token Manager fetch sequence number by batch

2020-03-02 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049589#comment-17049589 ] Xiaoyu Yao commented on HADOOP-16828: - Thanks [~fengnanli] for reporting the issue

[GitHub] [hadoop] karthikhw opened a new pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit

2020-03-02 Thread GitBox
karthikhw opened a new pull request #1870: HDFS-15201 SnapshotCounter hits MaxSnapshotID limit URL: https://github.com/apache/hadoop/pull/1870 This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [hadoop] bilaharith closed pull request #1866: HADOOP-16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
bilaharith closed pull request #1866: HADOOP-16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1866 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HADOOP-14936) S3Guard: remove "experimental" from documentation

2020-03-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049541#comment-17049541 ] Hudson commented on HADOOP-14936: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] steveloughran merged pull request #1863: HADOOP-14936. S3Guard: remove experimental from documentation

2020-03-02 Thread GitBox
steveloughran merged pull request #1863: HADOOP-14936. S3Guard: remove experimental from documentation URL: https://github.com/apache/hadoop/pull/1863 This is an automated message from the Apache Git Service. To respond to t

[jira] [Commented] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-03-02 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049518#comment-17049518 ] Mingliang Liu commented on HADOOP-16794: I see major backport conflicts from {{

[jira] [Commented] (HADOOP-16897) Sort fields in ReflectionUtils.java

2020-03-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049508#comment-17049508 ] Hudson commented on HADOOP-16897: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1866#issuecomment-593279025 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |:

[jira] [Issue Comment Deleted] (HADOOP-16890) ABFS: Change in expiry calculation for MSI token provider

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16890: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsys

[jira] [Resolved] (HADOOP-16897) Sort fields in ReflectionUtils.java

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16897. - Resolution: Fixed fixed in trunk -thanks! > Sort fields in ReflectionUtils.java >

[jira] [Updated] (HADOOP-16897) Sort fields in ReflectionUtils.java

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16897: Fix Version/s: 3.3.0 > Sort fields in ReflectionUtils.java >

[jira] [Assigned] (HADOOP-16897) Sort fields in ReflectionUtils.java

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16897: --- Assignee: cpugputpu > Sort fields in ReflectionUtils.java > --

[jira] [Updated] (HADOOP-16897) Sort fields in ReflectionUtils.java

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16897: Component/s: test > Sort fields in ReflectionUtils.java > ---

[jira] [Updated] (HADOOP-16897) Sort fields in ReflectionUtils.java

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16897: Affects Version/s: 3.3.0 > Sort fields in ReflectionUtils.java >

[GitHub] [hadoop] steveloughran merged pull request #1868: HADOOP-16897. Sort fields in ReflectionUtils.java

2020-03-02 Thread GitBox
steveloughran merged pull request #1868: HADOOP-16897. Sort fields in ReflectionUtils.java URL: https://github.com/apache/hadoop/pull/1868 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-03-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049495#comment-17049495 ] Hudson commented on HADOOP-16794: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[GitHub] [hadoop] steveloughran commented on issue #1868: HADOOP-16897. Sort fields in ReflectionUtils.java

2020-03-02 Thread GitBox
steveloughran commented on issue #1868: HADOOP-16897. Sort fields in ReflectionUtils.java URL: https://github.com/apache/hadoop/pull/1868#issuecomment-593529759 +1, committing. we all hate flaky tests. thanks for this This is

[GitHub] [hadoop] steveloughran commented on a change in pull request #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries URL: https://github.com/apache/hadoop/pull/1851#discussion_r386543844 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/s3guard/S3

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries URL: https://github.com/apache/hadoop/pull/1851#issuecomment-587107658 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |:---

[GitHub] [hadoop] steveloughran closed pull request #1843: HADOOP-16794. encryption over rename/copy

2020-03-02 Thread GitBox
steveloughran closed pull request #1843: HADOOP-16794. encryption over rename/copy URL: https://github.com/apache/hadoop/pull/1843 This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [hadoop] steveloughran closed pull request #1854: Hadoop 16864: TEST - NOT FOR CHECKIN

2020-03-02 Thread GitBox
steveloughran closed pull request #1854: Hadoop 16864: TEST - NOT FOR CHECKIN URL: https://github.com/apache/hadoop/pull/1854 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Commented] (HADOOP-16767) S3AInputStream reopening does not handle non IO exceptions properly

2020-03-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049480#comment-17049480 ] Hudson commented on HADOOP-16767: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

[jira] [Commented] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049471#comment-17049471 ] Steve Loughran commented on HADOOP-16794: - OK, merged in to trunk...feel free

[jira] [Updated] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16794: Fix Version/s: 3.3.0 > S3A reverts KMS encryption to the bucket's default KMS key in rena

[jira] [Updated] (HADOOP-16794) S3A reverts KMS encryption to the bucket's default KMS key in rename/copy

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16794: Summary: S3A reverts KMS encryption to the bucket's default KMS key in rename/copy (was:

[GitHub] [hadoop] steveloughran merged pull request #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation

2020-03-02 Thread GitBox
steveloughran merged pull request #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation URL: https://github.com/apache/hadoop/pull/1823 This is an automated message from the Apache Git Servic

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1823: HADOOP-16794 S3 Encryption keys not propagating correctly during copy operation URL: https://github.com/apache/hadoop/pull/1823#issuecomment-592163392 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comme

[jira] [Resolved] (HADOOP-16767) S3AInputStream reopening does not handle non IO exceptions properly

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16767. - Fix Version/s: 3.3.0 Resolution: Fixed > S3AInputStream reopening does not handl

[GitHub] [hadoop] steveloughran commented on issue #1766: HADOOP-16767 Handle non-IO exceptions in reopen()

2020-03-02 Thread GitBox
steveloughran commented on issue #1766: HADOOP-16767 Handle non-IO exceptions in reopen() URL: https://github.com/apache/hadoop/pull/1766#issuecomment-593514135 well, its a minor patch so I'll D/L and test myself, ` -Dparallel-tests -DtestsThreadCount=8 -Ds3guard -Ddynamo` So +1, me

[GitHub] [hadoop] steveloughran merged pull request #1766: HADOOP-16767 Handle non-IO exceptions in reopen()

2020-03-02 Thread GitBox
steveloughran merged pull request #1766: HADOOP-16767 Handle non-IO exceptions in reopen() URL: https://github.com/apache/hadoop/pull/1766 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r386488058 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azu

[jira] [Updated] (HADOOP-16818) ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16818: Component/s: fs/azure > ABFS: Combine append+flush calls for blockblob & appendblob > --

[GitHub] [hadoop] steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r386486689 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azu

[GitHub] [hadoop] steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r386485772 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azu

[jira] [Updated] (HADOOP-16818) ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16818: Affects Version/s: 3.3.0 > ABFS: Combine append+flush calls for blockblob & appendblob >

[GitHub] [hadoop] steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r386485353 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azu

[GitHub] [hadoop] steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r386488149 ## File path: hadoop-tools/hadoop-azure/src/test/java/org/apache/hadoop/fs/azu

[GitHub] [hadoop] steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r386481585 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azu

[GitHub] [hadoop] steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#discussion_r386483373 ## File path: hadoop-tools/hadoop-azure/src/site/markdown/abfs.md ##

[GitHub] [hadoop] steveloughran commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm,

2020-03-02 Thread GitBox
steveloughran commented on a change in pull request #1829: HDFS-14743. Enhance INodeAttributeProvider/ AccessControlEnforcer Interface in HDFS to support Authorization of mkdir, rm, rmdir, copy, move etc... URL: https://github.com/apache/hadoop/pull/1829#discussion_r386483778 ## Fi

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#issuecomment-583380344 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#issuecomment-579239147 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#issuecomment-585720440 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#issuecomment-587440341 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#issuecomment-590325640 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#issuecomment-590474367 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1790: [HADOOP-16818] ABFS: Combine append+flush calls for blockblob & appendblob URL: https://github.com/apache/hadoop/pull/1790#issuecomment-590257579 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment |

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1794: HADOOP-15887: Add an option to avoid writing data locally in Distcp

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1794: HADOOP-15887: Add an option to avoid writing data locally in Distcp URL: https://github.com/apache/hadoop/pull/1794#issuecomment-571893263 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |:-

[GitHub] [hadoop] hadoop-yetus removed a comment on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries

2020-03-02 Thread GitBox
hadoop-yetus removed a comment on issue #1851: HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries URL: https://github.com/apache/hadoop/pull/1851#issuecomment-591902751 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |:---

[GitHub] [hadoop] steveloughran edited a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-03-02 Thread GitBox
steveloughran edited a comment on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-593460073 closing as it merged in. thanks! This is an automated message

[GitHub] [hadoop] steveloughran commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-03-02 Thread GitBox
steveloughran commented on issue #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842#issuecomment-593460073 ok, This is an automated message from the Apache Git Service. To re

[GitHub] [hadoop] steveloughran closed pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface

2020-03-02 Thread GitBox
steveloughran closed pull request #1842: HADOOP-16730 : ABFS: Add Authorizer Interface URL: https://github.com/apache/hadoop/pull/1842 This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hadoop] steveloughran commented on issue #1869: HADOOP-16898. Batch listing of multiple directories to be an unstable interface

2020-03-02 Thread GitBox
steveloughran commented on issue #1869: HADOOP-16898. Batch listing of multiple directories to be an unstable interface URL: https://github.com/apache/hadoop/pull/1869#issuecomment-593459460 hey, can I get this in before hadoop 3.3.x ships; I don't want to make any commitment in that relea

[GitHub] [hadoop] steveloughran opened a new pull request #1869: HADOOP-16898. Batch listing of multiple directories to be an unstable interface

2020-03-02 Thread GitBox
steveloughran opened a new pull request #1869: HADOOP-16898. Batch listing of multiple directories to be an unstable interface URL: https://github.com/apache/hadoop/pull/1869 Contributed by Steve Loughran. Moves the API of HDFS-13616 into a interface which is implemented by DF

[jira] [Commented] (HADOOP-16890) ABFS: Change in expiry calculation for MSI token provider

2020-03-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049302#comment-17049302 ] Hadoop QA commented on HADOOP-16890: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1866#issuecomment-593450148 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[jira] [Commented] (HADOOP-16890) ABFS: Change in expiry calculation for MSI token provider

2020-03-02 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049265#comment-17049265 ] Hadoop QA commented on HADOOP-16890: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider

2020-03-02 Thread GitBox
hadoop-yetus commented on issue #1866: HADOOP-16890: Change in expiry calculation for MSI token provider URL: https://github.com/apache/hadoop/pull/1866#issuecomment-593435627 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--

[jira] [Created] (HADOOP-16898) Batch listing of multiple directories to be an unstable interface

2020-03-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-16898: --- Summary: Batch listing of multiple directories to be an unstable interface Key: HADOOP-16898 URL: https://issues.apache.org/jira/browse/HADOOP-16898 Project: Ha

[jira] [Commented] (HADOOP-16885) Encryption zone file copy failure leaks temp file ._COPYING_ and wrapped stream

2020-03-02 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049218#comment-17049218 ] Hudson commented on HADOOP-16885: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Co

  1   2   >