[jira] [Created] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in unit test

2017-02-22 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14106: -- Summary: Fix deprecated FileSystem inefficient calls in unit test Key: HADOOP-14106 URL: https://issues.apache.org/jira/browse/HADOOP-14106 Project: Hadoop Common

[jira] [Updated] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in unit test

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14106: --- Target Version/s: 3.0.0-alpha3 Component/s: test > Fix deprecated FileSystem ineffi

[jira] [Commented] (HADOOP-13321) Deprecate FileSystem APIs that promote inefficient call patterns.

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879420#comment-15879420 ] Mingliang Liu commented on HADOOP-13321: Thanks Steve! I filed [HADOOP-14106] f

[jira] [Created] (HADOOP-14107) ITestS3GuardListConsistency fails intermittently

2017-02-22 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14107: -- Summary: ITestS3GuardListConsistency fails intermittently Key: HADOOP-14107 URL: https://issues.apache.org/jira/browse/HADOOP-14107 Project: Hadoop Common

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Assignee: Varada Hemeswari Hadoop Flags: Reviewed Status: Patch Available

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Target Version/s: 2.9.0, 3.0.0-alpha3 +1 pending on Jenkins. Which Hadoop version are we ta

[jira] [Commented] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879560#comment-15879560 ] Mingliang Liu commented on HADOOP-14091: I also added you as the Hadoop Common p

[jira] [Commented] (HADOOP-13321) Deprecate FileSystem APIs that promote inefficient call patterns.

2017-02-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15879616#comment-15879616 ] Mingliang Liu commented on HADOOP-13321: Steve do you need another review? > De

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Target Version/s: 2.8.0, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha3) > AbstractFileSystem imple

[jira] [Commented] (HADOOP-14028) S3A block output streams don't delete temporary files in multipart uploads

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15880770#comment-15880770 ] Mingliang Liu commented on HADOOP-14028: Will do a review this week. Any more re

[jira] [Updated] (HADOOP-14112) Über-jira ADL Phase I: Stabilization

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14112: --- Target Version/s: 3.0.0-alpha3 Component/s: (was: fs/azure)

[jira] [Updated] (HADOOP-13321) Deprecate FileSystem APIs that promote inefficient call patterns.

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13321: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 S

[jira] [Updated] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14091: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.8.0 Stat

[jira] [Commented] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881411#comment-15881411 ] Mingliang Liu commented on HADOOP-13994: Sorry [~ste...@apache.org] I missed thi

[jira] [Comment Edited] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881411#comment-15881411 ] Mingliang Liu edited comment on HADOOP-13994 at 2/23/17 10:24 PM:

[jira] [Commented] (HADOOP-14113) review ADL Docs

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881474#comment-15881474 ] Mingliang Liu commented on HADOOP-14113: This format is clearer and user friendl

[jira] [Commented] (HADOOP-14028) S3A block output streams don't delete temporary files in multipart uploads

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881629#comment-15881629 ] Mingliang Liu commented on HADOOP-14028: +1 I learned a lot from the threads he

[jira] [Resolved] (HADOOP-14091) AbstractFileSystem implementaion for 'wasbs' scheme

2017-02-23 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-14091. Resolution: Fixed Sure, but let's track in our private channel. This is for community effo

[jira] [Commented] (HADOOP-14110) mark S3AFileSystem.getAmazonClient package private, export getBucketLocation(fs.getBucket());

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883347#comment-15883347 ] Mingliang Liu commented on HADOOP-14110: I have to admit it was me who made it p

[jira] [Updated] (HADOOP-14110) In S3AFileSystem, make getAmazonClient() package private; export getBucketLocation()

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14110: --- Summary: In S3AFileSystem, make getAmazonClient() package private; export getBucketLocation(

[jira] [Updated] (HADOOP-14110) In S3AFileSystem, make getAmazonClient() package private; export getBucketLocation()

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14110: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345 S

[jira] [Assigned] (HADOOP-14036) S3Guard: intermittent duplicate item keys failure

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-14036: -- Assignee: Mingliang Liu Assigned this to me. I'll have a look at this as I'm seeing t

[jira] [Updated] (HADOOP-14036) S3Guard: intermittent duplicate item keys failure

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14036: --- Affects Version/s: HADOOP-13345 > S3Guard: intermittent duplicate item keys failure > --

[jira] [Commented] (HADOOP-14028) S3A block output streams don't delete temporary files in multipart uploads

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883395#comment-15883395 ] Mingliang Liu commented on HADOOP-14028: {quote} IOUtilsClient#cleanup() because

[jira] [Reopened] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-13994: > explicitly declare the commons-lang3 dependency as 3.4 > ---

[jira] [Resolved] (HADOOP-13994) explicitly declare the commons-lang3 dependency as 3.4

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-13994. Resolution: Fixed > explicitly declare the commons-lang3 dependency as 3.4 > -

[jira] [Assigned] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in test

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HADOOP-14106: -- Assignee: Yiqun Lin Summary: Fix deprecated FileSystem inefficient calls in test

[jira] [Commented] (HADOOP-14106) Fix deprecated FileSystem inefficient calls in test

2017-02-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883967#comment-15883967 ] Mingliang Liu commented on HADOOP-14106: This can be a uber jira to track all ch

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886765#comment-15886765 ] Mingliang Liu commented on HADOOP-14129: It fails to me as well. I +1 to fix it

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Affects Version/s: HADOOP-13345 Target Version/s: HADOOP-13345 > ITestS3ACredentialsInU

[jira] [Commented] (HADOOP-13252) Tune S3A provider plugin mechanism

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15886967#comment-15886967 ] Mingliang Liu commented on HADOOP-13252: {code} 294 /** 295* Creat

[jira] [Created] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14130: -- Summary: Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients Key: HADOOP-14130 URL: https://issues.apache.org/jira/browse/HADOOP-14130 Project: Ha

[jira] [Commented] (HADOOP-14090) Allow users to specify region for DynamoDB table instead of endpoint

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887305#comment-15887305 ] Mingliang Liu commented on HADOOP-14090: Sorry for late chime in. I'm thinking

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Status: Patch Available (was: Open) > Simplify DynamoDBClientFactory for creating Amazon Dy

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Attachment: HADOOP-14130-HADOOP-13345.000.patch > Simplify DynamoDBClientFactory for creatin

[jira] [Commented] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887310#comment-15887310 ] Mingliang Liu commented on HADOOP-14130: I tested against us-west-2 using {{cmvn

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:35 AM: -

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887312#comment-15887312 ] Mingliang Liu commented on HADOOP-13914: Thanks [~fabbri]! I'll review this week

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Attachment: HADOOP-14130-HADOOP-13345.001.patch > Simplify DynamoDBClientFactory for creatin

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:51 AM: -

[jira] [Comment Edited] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887310#comment-15887310 ] Mingliang Liu edited comment on HADOOP-14130 at 2/28/17 5:50 AM: -

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Description: So, we are using deprecated {{AmazonDynamoDBClient}} class to create a DynamoDB

[jira] [Commented] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1576#comment-1576 ] Mingliang Liu commented on HADOOP-14130: {quote} I think that's likely to happe

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1599#comment-1599 ] Mingliang Liu commented on HADOOP-14129: +1 on v2 patch. Committed to feature br

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345 S

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Target Version/s: 3.0.0-alpha2, 2.8.0 (was: 3.0.0-alpha2) > Remove URI parameter in AWSCred

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Target Version/s: 3.0.0-alpha2 > Remove URI parameter in AWSCredentialProvider constructors

[jira] [Created] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14135: -- Summary: Remove URI parameter in AWSCredentialProvider constructors Key: HADOOP-14135 URL: https://issues.apache.org/jira/browse/HADOOP-14135 Project: Hadoop Commo

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Fix Version/s: (was: 2.8.0) > Remove URI parameter in AWSCredentialProvider constructors

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.000.patch > Remove URI parameter in AWSCredentialProvider construct

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Target Version/s: 3.0.0-alpha2, 2.8.0 (was: 2.8.0, 3.0.0-alpha2) Status: Patch

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889092#comment-15889092 ] Mingliang Liu commented on HADOOP-14135: Tested against use-west-1 region. {code

[jira] [Commented] (HADOOP-14036) S3Guard: intermittent duplicate item keys failure

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889266#comment-15889266 ] Mingliang Liu commented on HADOOP-14036: {quote} Maybe the code that makes sure

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889313#comment-15889313 ] Mingliang Liu commented on HADOOP-14129: I just re-produced the same error... {

[jira] [Updated] (HADOOP-14130) Simplify DynamoDBClientFactory for creating Amazon DynamoDB clients

2017-02-28 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14130: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HADOOP-13345 S

[jira] [Reopened] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reopened HADOOP-14129: > ITestS3ACredentialsInURL sometimes fails > > >

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Attachment: HADOOP-14129-HADOOP-13345.003.patch Attaching v3 patch. I tested and never see t

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Status: Patch Available (was: Reopened) > ITestS3ACredentialsInURL sometimes fails > --

[jira] [Commented] (HADOOP-14138) Remove S3A ref from META-INF service discovery, rely on existing core-default entry

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892955#comment-15892955 ] Mingliang Liu commented on HADOOP-14138: +1 > Remove S3A ref from META-INF serv

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Attachment: HADOOP-14129-HADOOP-13345.004.patch > ITestS3ACredentialsInURL sometimes fails >

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893205#comment-15893205 ] Mingliang Liu commented on HADOOP-14129: Thanks [~fabbri] for your review. I bel

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Attachment: HADOOP-14129-HADOOP-13345.005.patch @Steve I think the configuration are isolate

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.001.patch Thanks Steve. You're right we should be very careful abou

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893327#comment-15893327 ] Mingliang Liu commented on HADOOP-14135: Ping [~mackrorysd] for review. Thanks,

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.002.patch > Remove URI parameter in AWSCredentialProvider construct

[jira] [Updated] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14135: --- Attachment: HADOOP-14135.003.patch {code} $ mvn -Dit.test='ITestS3A*' -Dtest=none -Dscale -q

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893538#comment-15893538 ] Mingliang Liu commented on HADOOP-14135: Checkstyle warnings are false positive:

[jira] [Commented] (HADOOP-14094) Rethink S3GuardTool options

2017-03-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893553#comment-15893553 ] Mingliang Liu commented on HADOOP-14094: The v4 patch looks good to me overall.

[jira] [Commented] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15894913#comment-15894913 ] Mingliang Liu commented on HADOOP-13945: YARN UI module is definitely not relate

[jira] [Commented] (HADOOP-14094) Rethink S3GuardTool options

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895064#comment-15895064 ] Mingliang Liu commented on HADOOP-14094: {quote} it seemed like every Tool was

[jira] [Commented] (HADOOP-14135) Remove URI parameter in AWSCredentialProvider constructors

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895103#comment-15895103 ] Mingliang Liu commented on HADOOP-14135: Thanks [~mackrorysd] for your review.

[jira] [Commented] (HADOOP-14023) S3Guard: DynamoDBMetadataStore logs nonsense region

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895107#comment-15895107 ] Mingliang Liu commented on HADOOP-14023: [~mackrorysd] can you confirm that the

[jira] [Commented] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895112#comment-15895112 ] Mingliang Liu commented on HADOOP-14027: [~mackrorysd] the problem this JIRA tra

[jira] [Commented] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895191#comment-15895191 ] Mingliang Liu commented on HADOOP-13946: I'm +1 on the v4 patch. I'll hold on c

[jira] [Commented] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895196#comment-15895196 ] Mingliang Liu commented on HADOOP-14129: [~fabbri] is your vote valid for v5 pat

[jira] [Updated] (HADOOP-14129) ITestS3ACredentialsInURL sometimes fails

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14129: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to feature bran

[jira] [Commented] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895301#comment-15895301 ] Mingliang Liu commented on HADOOP-13945: Patch looks good to me overall. For a f

[jira] [Comment Edited] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895301#comment-15895301 ] Mingliang Liu edited comment on HADOOP-13945 at 3/4/17 12:28 AM: -

[jira] [Commented] (HADOOP-13945) Azure: Add Kerberos and Delegation token support to WASB client.

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895319#comment-15895319 ] Mingliang Liu commented on HADOOP-13945: As there are a lot of shared code to [H

[jira] [Updated] (HADOOP-13930) Azure: Add Authorization support to WASB

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13930: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

2017-03-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895426#comment-15895426 ] Mingliang Liu commented on HADOOP-13914: Thanks [~fabbri], this is really good i

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename of folder should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Summary: REDO operation of WASB#AtomicRename of folder should create placeholder blob for de

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Summary: REDO operation of WASB#AtomicRename should create placeholder blob for destination

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename of folder should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Updated] (HADOOP-14048) REDO operation of WASB#AtomicRename should create placeholder blob for destination folder

2017-03-06 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14048: --- Priority: Critical (was: Major) > REDO operation of WASB#AtomicRename should create placeho

[jira] [Commented] (HADOOP-14027) Implicitly creating DynamoDB table ignores endpoint config

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900295#comment-15900295 ] Mingliang Liu commented on HADOOP-14027: The patch looks good to me. +1 Nits: #

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0) Status: Patch Available (w

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900303#comment-15900303 ] Mingliang Liu commented on HADOOP-14150: Submitting the patch to trigger pre-com

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0, 3.0.0-alpha2) Hadoop Flags: Revie

[jira] [Commented] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900330#comment-15900330 ] Mingliang Liu commented on HADOOP-14150: +1 pending on Jenkins. > Implement get

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Fix Version/s: 3.0.0-alpha3 2.9.0 > Implement getHomeDirectory() method i

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Target Version/s: 2.9.0, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha2) > Implement getHomeDirecto

[jira] [Updated] (HADOOP-14150) Implement getHomeDirectory() method in NativeAzureFileSystem

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14150: --- Resolution: Fixed Target Version/s: 3.0.0-alpha2, 2.9.0 (was: 2.9.0, 3.0.0-alpha2)

[jira] [Updated] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13946: --- Attachment: HADOOP-13946-005.patch > Document how HDFS updates timestamps in the FS spec; co

[jira] [Updated] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-13946: --- Attachment: Screen Shot 2017-03-07 at 3.44.43 PM.png Chris' comment makes sense to me. I sli

[jira] [Comment Edited] (HADOOP-13946) Document how HDFS updates timestamps in the FS spec; compare with object stores

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900403#comment-15900403 ] Mingliang Liu edited comment on HADOOP-13946 at 3/7/17 11:46 PM: -

[jira] [Created] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
Mingliang Liu created HADOOP-14153: -- Summary: ADL module has messed doc structure Key: HADOOP-14153 URL: https://issues.apache.org/jira/browse/HADOOP-14153 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Issue Type: Sub-task (was: Bug) Parent: HADOOP-14112 > ADL module has messed doc st

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Attachment: HADOOP-14153.000.patch The v0 patch honors the original outline of the doc. > A

[jira] [Updated] (HADOOP-14153) ADL module has messed doc structure

2017-03-07 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HADOOP-14153: --- Status: Patch Available (was: Open) > ADL module has messed doc structure > ---

<    3   4   5   6   7   8   9   10   11   >