[jira] [Updated] (HADOOP-16163) NPE in setup/teardown of ITestAbfsDelegationTokens

2019-08-27 Thread Thomas Marquardt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-16163: -- Affects Version/s: 3.2.0 > NPE in setup/teardown of ITestAbfsDelegationTokens >

[jira] [Updated] (HADOOP-16340) ABFS driver continues to retry on IOException responses from REST operations

2019-08-27 Thread Thomas Marquardt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-16340: -- Affects Version/s: 3.2.0 > ABFS driver continues to retry on IOException responses

[jira] [Updated] (HADOOP-15832) Upgrade BouncyCastle to 1.60

2019-08-27 Thread Thomas Marquardt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15832: -- Target Version/s: 3.2.0, 3.3.0 (was: 3.3.0) > Upgrade BouncyCastle to 1.60 >

[jira] [Updated] (HADOOP-15832) Upgrade BouncyCastle to 1.60

2019-08-27 Thread Thomas Marquardt (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15832: -- Affects Version/s: 3.2.0 > Upgrade BouncyCastle to 1.60 >

[jira] [Resolved] (HADOOP-16405) Upgrade Wildfly Openssl version to 1.0.7.Final

2019-07-30 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt resolved HADOOP-16405. --- Resolution: Fixed Fix Version/s: 3.3.0 Duplicate of HADOOP-16460. >

[jira] [Updated] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-30 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-16460: -- Resolution: Fixed Status: Resolved (was: Patch Available) +1 Committed to

[jira] [Updated] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-30 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-16460: -- Fix Version/s: 3.3.0 > ABFS: fix for Sever Name Indication (SNI) >

[jira] [Commented] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-29 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895721#comment-16895721 ] Thomas Marquardt commented on HADOOP-16460: --- LGTM  Below are my local test results using a

[jira] [Updated] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-29 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-16460: -- Affects Version/s: 3.2.0 > ABFS: fix for Sever Name Indication (SNI) >

[jira] [Commented] (HADOOP-16405) Upgrade Wildfly Openssl version to 1.0.7.Final

2019-07-29 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895554#comment-16895554 ] Thomas Marquardt commented on HADOOP-16405: --- I am going to close HADOOP-16405 as a duplicate

[jira] [Assigned] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-29 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reassigned HADOOP-16460: - Assignee: Sneha Vijayarajan (was: Vishwajeet Dusane) > ABFS: fix for Sever

[jira] [Updated] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-29 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-16460: -- Status: Patch Available (was: Open) Clicking Submit Patch for Sneha and the PR at 

[jira] [Commented] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-29 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16895412#comment-16895412 ] Thomas Marquardt commented on HADOOP-16460: --- Sneha created a PR at 

[jira] [Created] (HADOOP-16460) ABFS: fix for Sever Name Indication (SNI)

2019-07-24 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-16460: - Summary: ABFS: fix for Sever Name Indication (SNI) Key: HADOOP-16460 URL: https://issues.apache.org/jira/browse/HADOOP-16460 Project: Hadoop Common

[jira] [Commented] (HADOOP-16317) ABFS: improve random read performance

2019-05-28 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850169#comment-16850169 ] Thomas Marquardt commented on HADOOP-16317: --- We can be smarter about choosing random vs

[jira] [Commented] (HADOOP-16041) UserAgent string for ABFS

2019-01-28 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754423#comment-16754423 ] Thomas Marquardt commented on HADOOP-16041: --- +1 looks good to me > UserAgent string for ABFS

[jira] [Commented] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2019-01-27 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753623#comment-16753623 ] Thomas Marquardt commented on HADOOP-15954: --- *CustomIdentityTransformer.java*: L94 - replace

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742401#comment-16742401 ] Thomas Marquardt commented on HADOOP-16044: --- Good questions, and the answers are complicated

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16742369#comment-16742369 ] Thomas Marquardt commented on HADOOP-16044: --- ABFS has been retrying on UnknownHostException

[jira] [Commented] (HADOOP-16044) ABFS: Better exception handling of DNS errors followup

2019-01-11 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740792#comment-16740792 ] Thomas Marquardt commented on HADOOP-16044: --- +1, LGTM > ABFS: Better exception handling of

[jira] [Commented] (HADOOP-16041) UserAgent string for ABFS

2019-01-11 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740785#comment-16740785 ] Thomas Marquardt commented on HADOOP-16041: --- For 2), I did not mention that the design is

[jira] [Commented] (HADOOP-16041) UserAgent string for ABFS

2019-01-11 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16740641#comment-16740641 ] Thomas Marquardt commented on HADOOP-16041: --- What are your goals for this change? There were

[jira] [Commented] (HADOOP-15662) ABFS: Better exception handling of DNS errors

2019-01-10 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739942#comment-16739942 ] Thomas Marquardt commented on HADOOP-15662: --- Some comments on the 002 patch:

[jira] [Commented] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2018-12-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713397#comment-16713397 ] Thomas Marquardt commented on HADOOP-15954: --- I have a few ideas about how we should design

[jira] [Commented] (HADOOP-15975) ABFS: remove timeout check for DELETE and RENAME

2018-12-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709472#comment-16709472 ] Thomas Marquardt commented on HADOOP-15975: --- +1, looks good to me!  We can also remove the

[jira] [Assigned] (HADOOP-15954) ABFS: Enable owner and group conversion for MSI and login user using OAuth

2018-12-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reassigned HADOOP-15954: - Assignee: Da Zhou (was: junhua gu) > ABFS: Enable owner and group conversion

[jira] [Commented] (HADOOP-15972) ABFS: update LIST_MAX_RESULTS

2018-12-04 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709328#comment-16709328 ] Thomas Marquardt commented on HADOOP-15972: --- +1, looks good.  Thank you. > ABFS: update

[jira] [Commented] (HADOOP-15969) ABFS: getNamespaceEnabled can fail blocking user access thru ACLs

2018-12-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708035#comment-16708035 ] Thomas Marquardt commented on HADOOP-15969: --- Thanks for the patch!  Some comments: 1) 

[jira] [Updated] (HADOOP-15969) ABFS: getNamespaceEnabled can fail blocking user access thru ACLs

2018-12-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15969: -- Description: The Get Filesystem Properties operation requires Read permission to the

[jira] [Commented] (HADOOP-15968) ABFS: add try catch for UGI failure when initializing ABFS

2018-12-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707974#comment-16707974 ] Thomas Marquardt commented on HADOOP-15968: --- Looks good.  I think it is easy to test using an

[jira] [Commented] (HADOOP-15940) ABFS: For HNS account, avoid unnecessary get call when doing Rename

2018-11-16 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16690161#comment-16690161 ] Thomas Marquardt commented on HADOOP-15940: --- Thanks for putting this together.  Yes, for a

[jira] [Commented] (HADOOP-15812) ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console

2018-11-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680522#comment-16680522 ] Thomas Marquardt commented on HADOOP-15812: --- +1  Thank you, the 005 patch looks good.  This

[jira] [Commented] (HADOOP-15812) ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console

2018-11-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679116#comment-16679116 ] Thomas Marquardt commented on HADOOP-15812: --- Can we add a test that verifies this message for

[jira] [Commented] (HADOOP-15812) ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console

2018-11-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679287#comment-16679287 ] Thomas Marquardt commented on HADOOP-15812: --- +1, looks good to me. > ABFS: Improve

[jira] [Commented] (HADOOP-15812) ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console

2018-11-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680159#comment-16680159 ] Thomas Marquardt commented on HADOOP-15812: --- No, 15812 does not depend on 15872.  This is

[jira] [Assigned] (HADOOP-15876) Use keySet().removeAll() to remove multiple keys from Map in AzureBlobFileSystemStore

2018-11-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reassigned HADOOP-15876: - Assignee: Da Zhou > Use keySet().removeAll() to remove multiple keys from Map

[jira] [Commented] (HADOOP-15846) ABFS: fix mask related bugs in setAcl, modifyAclEntries and removeAclEntries.

2018-11-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678910#comment-16678910 ] Thomas Marquardt commented on HADOOP-15846: --- +1, looks good to me. > ABFS: fix mask related

[jira] [Commented] (HADOOP-15876) Use keySet().removeAll() to remove multiple keys from Map in AzureBlobFileSystemStore

2018-11-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679119#comment-16679119 ] Thomas Marquardt commented on HADOOP-15876: --- +1, looks good to me. > Use

[jira] [Assigned] (HADOOP-15872) ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2

2018-10-25 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reassigned HADOOP-15872: - Assignee: junhua gu (was: Thomas Marquardt) > ABFS: Update to target

[jira] [Updated] (HADOOP-15872) ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2

2018-10-24 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15872: -- Description: This update to the latest REST version (2018-11-09) will make the

[jira] [Updated] (HADOOP-15872) ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2

2018-10-24 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15872: -- Summary: ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2 (was: ABFS:

[jira] [Updated] (HADOOP-15872) ABFS:

2018-10-24 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15872: -- Summary: ABFS: (was: ABFS: getFileStatus should only require execute permission on

[jira] [Updated] (HADOOP-15872) ABFS:

2018-10-24 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15872: -- Description: The ABFS implementation of getFileStatus currently requires read

[jira] [Created] (HADOOP-15872) ABFS: getFileStatus should only require execute permission on the parent folders

2018-10-22 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-15872: - Summary: ABFS: getFileStatus should only require execute permission on the parent folders Key: HADOOP-15872 URL: https://issues.apache.org/jira/browse/HADOOP-15872

[jira] [Commented] (HADOOP-15842) add fs.azure.account.oauth2.client.secret to hadoop.security.sensitive-config-keys

2018-10-11 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646740#comment-16646740 ] Thomas Marquardt commented on HADOOP-15842: --- I believe we need "fs.azure.account.oauth2.*",

[jira] [Created] (HADOOP-15846) ABFS: modifyAclEntries should not remove mask

2018-10-11 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-15846: - Summary: ABFS: modifyAclEntries should not remove mask Key: HADOOP-15846 URL: https://issues.apache.org/jira/browse/HADOOP-15846 Project: Hadoop Common

[jira] [Commented] (HADOOP-15841) ABFS: change createRemoteFileSystemDuringInitialization default to true

2018-10-10 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645977#comment-16645977 ] Thomas Marquardt commented on HADOOP-15841: --- Fine with me. The down side is that due to a

[jira] [Commented] (HADOOP-15823) ABFS: Stop requiring client ID and tenant ID for MSI

2018-10-10 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645904#comment-16645904 ] Thomas Marquardt commented on HADOOP-15823: --- +1 > ABFS: Stop requiring client ID and tenant

[jira] [Reopened] (HADOOP-15839) Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys

2018-10-10 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reopened HADOOP-15839: --- Looks like we missed things like "fs.azure.account.oauth2.client.secret".  See my

[jira] [Commented] (HADOOP-15839) Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys

2018-10-10 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645248#comment-16645248 ] Thomas Marquardt commented on HADOOP-15839: --- I am not familiar with  

[jira] [Commented] (HADOOP-15823) ABFS: Stop requiring client ID and tenant ID for MSI

2018-10-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642380#comment-16642380 ] Thomas Marquardt commented on HADOOP-15823: --- [~mackrorysd], [~DanielZhou] correct, the tenant

[jira] [Commented] (HADOOP-15795) Making HTTPS as default for ABFS

2018-10-03 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636507#comment-16636507 ] Thomas Marquardt commented on HADOOP-15795: --- +1 > Making HTTPS as default for ABFS >

[jira] [Commented] (HADOOP-15795) Making HTTPS as default for ABFS

2018-10-02 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636351#comment-16636351 ] Thomas Marquardt commented on HADOOP-15795: --- +1, LGTM > Making HTTPS as default for ABFS >

[jira] [Commented] (HADOOP-15795) Making HTTPS as default for ABFS

2018-10-02 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636099#comment-16636099 ] Thomas Marquardt commented on HADOOP-15795: --- AzureBlobFileSystem.java   L157: isSecure

[jira] [Commented] (HADOOP-15770) Merge HADOOP-15407 to trunk

2018-09-19 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621184#comment-16621184 ] Thomas Marquardt commented on HADOOP-15770: --- Two questions 1) Some of the dependency changes

[jira] [Commented] (HADOOP-15773) ABFS: Fix issues raised by Yetus

2018-09-19 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621165#comment-16621165 ] Thomas Marquardt commented on HADOOP-15773: --- +1, looks good to me.  I'll wait for you to

[jira] [Commented] (HADOOP-15723) ABFS: Ranger Support

2018-09-19 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621090#comment-16621090 ] Thomas Marquardt commented on HADOOP-15723: --- [~kowon2008], looks good, thank you for

[jira] [Updated] (HADOOP-15712) WASB to increase output stream close more robustly

2018-09-18 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15712: -- Summary: WASB to increase output stream close more robustly (was: ABFS to increase

[jira] [Comment Edited] (HADOOP-15719) Fail-fast when using OAuth over http

2018-09-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618268#comment-16618268 ] Thomas Marquardt edited comment on HADOOP-15719 at 9/17/18 11:18 PM:

[jira] [Commented] (HADOOP-15719) Fail-fast when using OAuth over http

2018-09-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618268#comment-16618268 ] Thomas Marquardt commented on HADOOP-15719: --- # TestOauthFailOverHttp.java: The import order

[jira] [Commented] (HADOOP-15744) AbstractContractAppendTest fails against HDFS on HADOOP-15407 branch

2018-09-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618250#comment-16618250 ] Thomas Marquardt commented on HADOOP-15744: --- +1, looks good to me.  I agree with your

[jira] [Commented] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-09-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618204#comment-16618204 ] Thomas Marquardt commented on HADOOP-15407: --- I was able to successfully rebase on trunk.  The

[jira] [Commented] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-09-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618111#comment-16618111 ] Thomas Marquardt commented on HADOOP-15407: --- Ok, it is good to know that the rebase was a

[jira] [Commented] (HADOOP-15407) Support Windows Azure Storage - Blob file system in Hadoop

2018-09-17 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618070#comment-16618070 ] Thomas Marquardt commented on HADOOP-15407: --- I am going to rebase branch HADOOP-15407 on the

[jira] [Updated] (HADOOP-15757) ABFS: remove dependency on common-codec Base64

2018-09-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15757: -- Resolution: Fixed Status: Resolved (was: Patch Available) commit

[jira] [Commented] (HADOOP-15757) ABFS: remove dependency on common-codec Base64

2018-09-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615464#comment-16615464 ] Thomas Marquardt commented on HADOOP-15757: --- +1 on the 002 patch.  As long as Yetus gives a

[jira] [Commented] (HADOOP-15757) ABFS: remove dependency on common-codec Base64

2018-09-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615380#comment-16615380 ] Thomas Marquardt commented on HADOOP-15757: --- LGTM, couple minor comments: *Base64.java*:  

[jira] [Updated] (HADOOP-15753) ABFS: support path "abfs://mycluster/file/path"

2018-09-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15753: -- Resolution: Fixed Status: Resolved (was: Patch Available) commit

[jira] [Commented] (HADOOP-15753) ABFS: support path "abfs://mycluster/file/path"

2018-09-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615126#comment-16615126 ] Thomas Marquardt commented on HADOOP-15753: --- +1, LGTM.  I will push this now. Tests pass for

[jira] [Commented] (HADOOP-15753) ABFS: support path "abfs://mycluster/file/path"

2018-09-14 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615060#comment-16615060 ] Thomas Marquardt commented on HADOOP-15753: --- Looks like both wasb and s3a also ignore the

[jira] [Commented] (HADOOP-15739) ABFS: remove unused maven dependencies and add used undeclared dependencies

2018-09-13 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614160#comment-16614160 ] Thomas Marquardt commented on HADOOP-15739: --- # Can we update the test to use slf4j instead of

[jira] [Assigned] (HADOOP-15723) ABFS: Ranger Support

2018-09-13 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reassigned HADOOP-15723: - Assignee: Da Zhou (was: Thomas Marquardt) > ABFS: Ranger Support >

[jira] [Commented] (HADOOP-15723) ABFS: Ranger Support

2018-09-13 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614125#comment-16614125 ] Thomas Marquardt commented on HADOOP-15723: --- [~kowon2008], please refer to

[jira] [Assigned] (HADOOP-15723) ABFS: Ranger Support

2018-09-13 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt reassigned HADOOP-15723: - Assignee: Thomas Marquardt > ABFS: Ranger Support > > >

[jira] [Commented] (HADOOP-15714) tune abfs/wasb parallel the sequential test execution

2018-09-13 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614110#comment-16614110 ] Thomas Marquardt commented on HADOOP-15714: --- Ok, I can confirm that *-Dparallel-tests=both*

[jira] [Commented] (HADOOP-15714) tune abfs/wasb parallel the sequential test execution

2018-09-13 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614041#comment-16614041 ] Thomas Marquardt commented on HADOOP-15714: --- I cannot run all the tests anymore.  The command

[jira] [Updated] (HADOOP-15694) ABFS: Allow OAuth credentials to not be tied to accounts

2018-09-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15694: -- Resolution: Fixed Status: Resolved (was: Patch Available) commit

[jira] [Commented] (HADOOP-15694) ABFS: Allow OAuth credentials to not be tied to accounts

2018-09-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612829#comment-16612829 ] Thomas Marquardt commented on HADOOP-15694: --- +1 LGTM  All tests pass for me too.  Let's wait

[jira] [Updated] (HADOOP-15740) ABFS: Check variable names during initialization of AbfsClientThrottlingIntercept

2018-09-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15740: -- Resolution: Fixed Status: Resolved (was: Patch Available) commit

[jira] [Commented] (HADOOP-15740) ABFS: Check variable names during initialization of AbfsClientThrottlingIntercept

2018-09-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612789#comment-16612789 ] Thomas Marquardt commented on HADOOP-15740: --- +1  All tests pass for me too.  I will push

[jira] [Commented] (HADOOP-15694) ABFS: Allow OAuth credentials to not be tied to accounts

2018-09-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612708#comment-16612708 ] Thomas Marquardt commented on HADOOP-15694: --- Thanks Sean, it is great that you already run

[jira] [Commented] (HADOOP-15694) ABFS: Allow OAuth credentials to not be tied to accounts

2018-09-12 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612641#comment-16612641 ] Thomas Marquardt commented on HADOOP-15694: --- +1.  Thanks for including test results Da. 

[jira] [Commented] (HADOOP-15744) AbstractContractAppendTest fails against HDFS on HADOOP-15407 branch

2018-09-11 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610886#comment-16610886 ] Thomas Marquardt commented on HADOOP-15744: --- I'm not sure I understand the issue.  How is

[jira] [Commented] (HADOOP-15740) ABFS: Check variable names during initialization of AbfsClientThrottlingIntercept

2018-09-11 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610874#comment-16610874 ] Thomas Marquardt commented on HADOOP-15740: --- +1, but you need to share the results from

[jira] [Commented] (HADOOP-15677) WASB: Add support for StreamCapabilities

2018-09-10 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609487#comment-16609487 ] Thomas Marquardt commented on HADOOP-15677: --- Thanks Steve, I see that there are a number of

[jira] [Commented] (HADOOP-15728) ABFS: Add backward compatibility to handle Unsupported Operation for storage account with no namespace feature

2018-09-10 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609466#comment-16609466 ] Thomas Marquardt commented on HADOOP-15728: --- Thanks Steve, sure, I will be sure to include +1

[jira] [Commented] (HADOOP-15694) ABFS: Allow OAuth credentials to not be tied to accounts

2018-09-08 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16608273#comment-16608273 ] Thomas Marquardt commented on HADOOP-15694: --- # *AbfsConfiguration.java@L212*:  getBoolean

[jira] [Commented] (HADOOP-15694) ABFS: Allow OAuth credentials to not be tied to accounts

2018-09-07 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607799#comment-16607799 ] Thomas Marquardt commented on HADOOP-15694: --- Unfortunately, we cannot change the KeyProvider

[jira] [Updated] (HADOOP-15728) ABFS: Add backward compatibility to handle Unsupported Operation for storage account with no namespace feature

2018-09-06 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15728: -- Resolution: Fixed Status: Resolved (was: Patch Available) commit

[jira] [Commented] (HADOOP-15728) ABFS: Add backward compatibility to handle Unsupported Operation for storage account with no namespace feature

2018-09-06 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606609#comment-16606609 ] Thomas Marquardt commented on HADOOP-15728: --- Looks good, some feedback:

[jira] [Updated] (HADOOP-15715) ITestAzureBlobFileSystemE2E timing out with non-scale timeout of 10 min

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15715: -- Status: Open (was: Patch Available) > ITestAzureBlobFileSystemE2E timing out with

[jira] [Updated] (HADOOP-15715) ITestAzureBlobFileSystemE2E timing out with non-scale timeout of 10 min

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15715: -- Status: Patch Available (was: Open) resubmit > ITestAzureBlobFileSystemE2E timing

[jira] [Updated] (HADOOP-15714) tune abfs/wasb parallel the sequential test execution

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15714: -- Status: Patch Available (was: Open) resubmit  > tune abfs/wasb parallel the

[jira] [Updated] (HADOOP-15714) tune abfs/wasb parallel the sequential test execution

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15714: -- Status: Open (was: Patch Available) > tune abfs/wasb parallel the sequential test

[jira] [Updated] (HADOOP-15703) ABFS - Implement client-side throttling

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15703: -- Resolution: Fixed Status: Resolved (was: Patch Available) commit

[jira] [Commented] (HADOOP-15703) ABFS - Implement client-side throttling

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605155#comment-16605155 ] Thomas Marquardt commented on HADOOP-15703: --- When I run findbugs on this locally it succeeds. 

[jira] [Updated] (HADOOP-15703) ABFS - Implement client-side throttling

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Marquardt updated HADOOP-15703: -- Attachment: HADOOP-15703-HADOOP-15407-004.patch > ABFS - Implement client-side

[jira] [Commented] (HADOOP-15703) ABFS - Implement client-side throttling

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605004#comment-16605004 ] Thomas Marquardt commented on HADOOP-15703: --- Let me try submitting the same patch again as

[jira] [Commented] (HADOOP-15703) ABFS - Implement client-side throttling

2018-09-05 Thread Thomas Marquardt (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604991#comment-16604991 ] Thomas Marquardt commented on HADOOP-15703: --- [~mackrorysd], somehow Yetus is confused.  The

[jira] [Created] (HADOOP-15723) ABFS: Ranger Support

2018-09-05 Thread Thomas Marquardt (JIRA)
Thomas Marquardt created HADOOP-15723: - Summary: ABFS: Ranger Support Key: HADOOP-15723 URL: https://issues.apache.org/jira/browse/HADOOP-15723 Project: Hadoop Common Issue Type:

  1   2   3   >