[jira] [Work started] (HADOOP-13980) S3Guard CLI: Add fsck check command

2019-02-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-13980 started by Gabor Bota. --- > S3Guard CLI: Add fsck check command > --- > >

[jira] [Assigned] (HADOOP-14576) s3guard DynamoDB resource not found: tables not ACTIVE state after initial connection

2019-02-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota reassigned HADOOP-14576: --- Assignee: (was: Gabor Bota) > s3guard DynamoDB resource not found: tables not ACTIVE

[jira] [Commented] (HADOOP-14576) s3guard DynamoDB resource not found: tables not ACTIVE state after initial connection

2019-02-05 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761532#comment-16761532 ] Gabor Bota commented on HADOOP-14576: - I haven't seen this error yet during testing or running

[jira] [Commented] (HADOOP-13402) S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS.

2019-02-05 Thread vaibhav beriwala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761448#comment-16761448 ] vaibhav beriwala commented on HADOOP-13402: --- Thanks for the detailed clarification

[jira] [Commented] (HADOOP-16094) AuthenticationFilter can trigger NullPointerException in KerberosName class

2019-02-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761334#comment-16761334 ] Hadoop QA commented on HADOOP-16094: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16092) Move the source of hadoop/ozone containers to the same repository

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761326#comment-16761326 ] Eric Yang commented on HADOOP-16092: [~elek] Tag/branch problem maybe solved using the

[jira] [Commented] (HADOOP-16091) Create hadoop/ozone docker images with inline build process

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761329#comment-16761329 ] Eric Yang commented on HADOOP-16091: For inline build process, it would be easy to create maven

[jira] [Commented] (HADOOP-16023) Support system /etc/krb5.conf for auth_to_local rules

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761308#comment-16761308 ] Eric Yang commented on HADOOP-16023: Good to know JDK parser is working as designed. Is this the

[jira] [Updated] (HADOOP-16094) AuthenticationFilter can trigger NullPointerException in KerberosName class

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-16094: --- Assignee: Eric Yang Status: Patch Available (was: Open) > AuthenticationFilter can trigger

[jira] [Commented] (HADOOP-16094) AuthenticationFilter can trigger NullPointerException in KerberosName class

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761292#comment-16761292 ] Eric Yang commented on HADOOP-16094: I am in favor of documentation changes to implement a listener

[jira] [Updated] (HADOOP-16094) AuthenticationFilter can trigger NullPointerException in KerberosName class

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-16094: --- Attachment: HADOOP-16094.001.patch > AuthenticationFilter can trigger NullPointerException in

[jira] [Comment Edited] (HADOOP-16023) Support system /etc/krb5.conf for auth_to_local rules

2019-02-05 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761280#comment-16761280 ] Bolke de Bruin edited comment on HADOOP-16023 at 2/5/19 10:37 PM: -- I

[jira] [Commented] (HADOOP-16023) Support system /etc/krb5.conf for auth_to_local rules

2019-02-05 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761280#comment-16761280 ] Bolke de Bruin commented on HADOOP-16023: - I initially thought that the following is allowed:  

[jira] [Commented] (HADOOP-16023) Support system /etc/krb5.conf for auth_to_local rules

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761270#comment-16761270 ] Eric Yang commented on HADOOP-16023: [~bolke] Can you elaborate on mistaken in the allowed formats?

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761259#comment-16761259 ] Hadoop QA commented on HADOOP-15281: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-16094) AuthenticationFilter can trigger NullPointerException in KerberosName class

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761227#comment-16761227 ] Eric Yang commented on HADOOP-16094: Hadoop-auth project builds before Hadoop-common, yet

[jira] [Commented] (HADOOP-16023) Support system /etc/krb5.conf for auth_to_local rules

2019-02-05 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761222#comment-16761222 ] Bolke de Bruin commented on HADOOP-16023: - [~eyang] sorry some updates # Patch landed in

[jira] [Updated] (HADOOP-16094) AuthenticationFilter can trigger NullPointerException in KerberosName class

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HADOOP-16094: --- Affects Version/s: 3.1.2 3.3.0 3.2.0 >

[jira] [Created] (HADOOP-16094) AuthenticationFilter can trigger NullPointerException in KerberosName class

2019-02-05 Thread Eric Yang (JIRA)
Eric Yang created HADOOP-16094: -- Summary: AuthenticationFilter can trigger NullPointerException in KerberosName class Key: HADOOP-16094 URL: https://issues.apache.org/jira/browse/HADOOP-16094 Project:

[GitHub] c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254043661 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/NativeAzureFileSystem.java

[GitHub] c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254042978 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[jira] [Comment Edited] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761032#comment-16761032 ] Andrew Olson edited comment on HADOOP-15281 at 2/5/19 8:47 PM: --- Thanks

[GitHub] c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254041614 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/NativeAzureFileSystem.java

[GitHub] c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254041510 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254041435 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
c-w commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254041359 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/NativeAzureFileSystem.java

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761199#comment-16761199 ] Andrew Olson commented on HADOOP-15281: --- Attached updated patch addressing the review feedback.

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Attachment: HADOOP-15281-004.patch > Distcp to add no-rename copy option >

[jira] [Updated] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Olson updated HADOOP-15281: -- Description: Currently Distcp uploads a file by two strategies # append parts # copy to

[jira] [Commented] (HADOOP-16005) NativeAzureFileSystem does not support setXAttr

2019-02-05 Thread Da Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761190#comment-16761190 ] Da Zhou commented on HADOOP-16005: -- BTW, [~ste...@apache.org] why don't we send PR through github?

[jira] [Commented] (HADOOP-16005) NativeAzureFileSystem does not support setXAttr

2019-02-05 Thread Da Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761181#comment-16761181 ] Da Zhou commented on HADOOP-16005: -- Thank you [~c-w] for your work! I like your GitHub PR and the test

[GitHub] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254031505 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254025116 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java

[GitHub] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254022007 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/NativeAzureFileSystem.java

[GitHub] DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS

2019-02-05 Thread GitBox
DadanielZ commented on a change in pull request #452: HADOOP-16005: Add XAttr support to WASB and ABFS URL: https://github.com/apache/hadoop/pull/452#discussion_r254022158 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azure/NativeAzureFileSystem.java

[jira] [Commented] (HADOOP-16023) Support system /etc/krb5.conf for auth_to_local rules

2019-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761176#comment-16761176 ] Eric Yang commented on HADOOP-16023: [~bolke] Any update? > Support system /etc/krb5.conf for

[jira] [Commented] (HADOOP-16061) Update Apache Yetus to 0.9.0

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761170#comment-16761170 ] Steve Loughran commented on HADOOP-16061: - we'll have the email address

[jira] [Updated] (HADOOP-16073) Use JDK1.7 StandardCharsets

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16073: Status: Patch Available (was: Open) > Use JDK1.7 StandardCharsets >

[jira] [Updated] (HADOOP-16086) Backport HADOOP-15549 to branch-3.1

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16086: Resolution: Fixed Assignee: Todd Lipcon Fix Version/s: 3.0.2

[jira] [Commented] (HADOOP-16083) DistCp shouldn't always overwrite the target file when checksums match

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761161#comment-16761161 ] Steve Loughran commented on HADOOP-16083: - I understand. It's the special case of single file

[jira] [Commented] (HADOOP-16087) Backport HADOOP-15549 to branch-3.0

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761159#comment-16761159 ] Steve Loughran commented on HADOOP-16087: - +1, cherry picked the branch-3.1 patch in. >

[jira] [Updated] (HADOOP-16087) Backport HADOOP-15549 to branch-3.0

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16087: Resolution: Fixed Assignee: Todd Lipcon Fix Version/s: 3.1.3

[jira] [Commented] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2019-02-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761146#comment-16761146 ] Hudson commented on HADOOP-15954: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15894 (See

[jira] [Commented] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761136#comment-16761136 ] Steve Loughran commented on HADOOP-15954: - BTW, gave both of you credit for the work. thanks!

[jira] [Updated] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15954: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch

[jira] [Commented] (HADOOP-16077) Add an option in ls command to include storage policy

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761121#comment-16761121 ] Steve Loughran commented on HADOOP-16077: - Tested the patch against the local store and got a

[jira] [Commented] (HADOOP-16059) Use SASL Factories Cache to Improve Performance

2019-02-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761124#comment-16761124 ] Wei-Chiu Chuang commented on HADOOP-16059: -- Thanks for clarification, [~ayushtkn] I

[jira] [Commented] (HADOOP-15710) ABFS checkException to map 403 to AccessDeniedException

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761123#comment-16761123 ] Steve Loughran commented on HADOOP-15710: - Reviewing, issue still here. checkException should

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761089#comment-16761089 ] Dmitri Chmelev commented on HADOOP-16090: - {quote}So do it when createFile() is kicked off?

[jira] [Assigned] (HADOOP-15710) ABFS checkException to map 403 to AccessDeniedException

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15710: --- Assignee: (was: Steve Loughran) > ABFS checkException to map 403 to

[jira] [Commented] (HADOOP-15582) Document ABFS

2019-02-05 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761081#comment-16761081 ] Sean Mackrory commented on HADOOP-15582: I can probably take care of this next week. >

[jira] [Commented] (HADOOP-16032) Distcp It should clear sub directory ACL before applying new ACL on it.

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761074#comment-16761074 ] Steve Loughran commented on HADOOP-16032: - Makes sense, nice low-diff to production code, and a

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761068#comment-16761068 ] Steve Loughran commented on HADOOP-16090: - {{copyFromLocalFile}} has its own issues

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761032#comment-16761032 ] Andrew Olson commented on HADOOP-15281: --- Thanks [~ste...@apache.org], I'll get those suggested

[jira] [Commented] (HADOOP-16091) Create hadoop/ozone docker images with inline build process

2019-02-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761033#comment-16761033 ] Anu Engineer commented on HADOOP-16091: --- bq. Note: based on LEGAL-270 and linked discussion both

[jira] [Commented] (HADOOP-16005) NativeAzureFileSystem does not support setXAttr

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761026#comment-16761026 ] Steve Loughran commented on HADOOP-16005: - [~tmarquardt], [~DanielZhou] - have you two looked

[jira] [Commented] (HADOOP-15582) Document ABFS

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761024#comment-16761024 ] Steve Loughran commented on HADOOP-15582: - We're still pretty bare here. Are there any

[jira] [Commented] (HADOOP-15862) ABFS to support a Delegation Token provider which marshalls current login secrets

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761025#comment-16761025 ] Steve Loughran commented on HADOOP-15862: - HADOOP-16068 adds the basis for this; I'm not

[jira] [Created] (HADOOP-16093) Move DurationInfo from hadoop-aws to hadoop-common org.apache.fs.impl

2019-02-05 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16093: --- Summary: Move DurationInfo from hadoop-aws to hadoop-common org.apache.fs.impl Key: HADOOP-16093 URL: https://issues.apache.org/jira/browse/HADOOP-16093

[jira] [Commented] (HADOOP-15281) Distcp to add no-rename copy option

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760999#comment-16760999 ] Steve Loughran commented on HADOOP-15281: - right, really good piece fo work, nearly ready to go

[jira] [Commented] (HADOOP-13402) S3A should allow renaming to a pre-existing destination directory to move the source path under that directory, similar to HDFS.

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760902#comment-16760902 ] Steve Loughran commented on HADOOP-13402: - [~vaibhavb] its a running joke that "everybody gets

[jira] [Commented] (HADOOP-16074) WASB: Update container not found error code

2019-02-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760896#comment-16760896 ] Hudson commented on HADOOP-16074: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15890 (See

[jira] [Updated] (HADOOP-16074) WASB: Update container not found error code

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16074: Resolution: Fixed Fix Version/s: 3.2.1 Status: Resolved (was: Patch

[GitHub] alex-bodo closed pull request #448: YARN-9094. Remove unused method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

2019-02-05 Thread GitBox
alex-bodo closed pull request #448: YARN-9094. Remove unused method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM URL: https://github.com/apache/hadoop/pull/448 This is an automated message from the Apache Git

[jira] [Commented] (HADOOP-16077) Add an option in ls command to include storage policy

2019-02-05 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760779#comment-16760779 ] Ayush Saxena commented on HADOOP-16077: --- Test Failures not related. Pls Review :) > Add an

[jira] [Commented] (HADOOP-16059) Use SASL Factories Cache to Improve Performance

2019-02-05 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760774#comment-16760774 ] Ayush Saxena commented on HADOOP-16059: --- Thanx [~jojochuang] for coming up and giving it a look.

[jira] [Assigned] (HADOOP-16069) Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST

2019-02-05 Thread luhuachao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuachao reassigned HADOOP-16069: -- Assignee: luhuachao > Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in >

[jira] [Commented] (HADOOP-16077) Add an option in ls command to include storage policy

2019-02-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760767#comment-16760767 ] Hadoop QA commented on HADOOP-16077: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-16069) Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in ZKDelegationTokenSecretManager using principal with Schema /_HOST

2019-02-05 Thread luhuachao (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuachao updated HADOOP-16069: --- Fix Version/s: 3.1.1 3.1.2 > Support configure ZK_DTSM_ZK_KERBEROS_PRINCIPAL in

[GitHub] elek closed pull request #478: HDDS-987. MultipartUpload: S3API for list parts of a object.

2019-02-05 Thread GitBox
elek closed pull request #478: HDDS-987. MultipartUpload: S3API for list parts of a object. URL: https://github.com/apache/hadoop/pull/478 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] elek commented on issue #478: HDDS-987. MultipartUpload: S3API for list parts of a object.

2019-02-05 Thread GitBox
elek commented on issue #478: HDDS-987. MultipartUpload: S3API for list parts of a object. URL: https://github.com/apache/hadoop/pull/478#issuecomment-460621890 Merged to the trunk. This is an automated message from the

[jira] [Commented] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

2019-02-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760743#comment-16760743 ] Hudson commented on HADOOP-15229: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15888 (See

[jira] [Updated] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11867: Component/s: fs/s3 fs/azure > FS API: Add a high-performance vectored

[jira] [Commented] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK

2019-02-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760741#comment-16760741 ] Hadoop QA commented on HADOOP-13887: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760739#comment-16760739 ] Steve Loughran commented on HADOOP-11867: - HADOOP-15229 is in; this can be the followon step

[jira] [Updated] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-11867: Component/s: fs > FS API: Add a high-performance vectored Read to FSDataInputStream API

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Resolution: Fixed Fix Version/s: 3.3.0 Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-15229) Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

2019-02-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15229: Summary: Add FileSystem builder-based openFile() API to match createFile(); S3A to

[jira] [Created] (HADOOP-16092) Move the source of hadoop/ozone containers to the same repository

2019-02-05 Thread Elek, Marton (JIRA)
Elek, Marton created HADOOP-16092: - Summary: Move the source of hadoop/ozone containers to the same repository Key: HADOOP-16092 URL: https://issues.apache.org/jira/browse/HADOOP-16092 Project:

[jira] [Created] (HADOOP-16091) Create hadoop/ozone docker images with inline build process

2019-02-05 Thread Elek, Marton (JIRA)
Elek, Marton created HADOOP-16091: - Summary: Create hadoop/ozone docker images with inline build process Key: HADOOP-16091 URL: https://issues.apache.org/jira/browse/HADOOP-16091 Project: Hadoop

[jira] [Updated] (HADOOP-16077) Add an option in ls command to include storage policy

2019-02-05 Thread Ayush Saxena (JIRA)

[jira] [Commented] (HADOOP-16090) deleteUnnecessaryFakeDirectories() creates unnecessary delete markers in a versioned S3 bucket

2019-02-05 Thread Dmitri Chmelev (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760577#comment-16760577 ] Dmitri Chmelev commented on HADOOP-16090: - Another idea is to amortize the cost of the

[jira] [Commented] (HADOOP-15999) [s3a] Better support for out-of-band operations

2019-02-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760547#comment-16760547 ] Hadoop QA commented on HADOOP-15999: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||