[jira] [Commented] (HADOOP-13761) S3Guard: implement retries for DDB failures and throttling; translate exceptions

[ https://issues.apache.org/jira/browse/HADOOP-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338852#comment-16338852 ] Aaron Fabbri commented on HADOOP-13761: --- Wrote a test to check above hypothesis on batch size vs.

[jira] [Updated] (HADOOP-15191) Add Private/Unstable BulkDelete operations to FS/S3A for DistCP

[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15191: Status: Patch Available (was: Open) HADOOP-15191 patch 001; PoC, not tested contains

[jira] [Updated] (HADOOP-15191) Add Private/Unstable BulkDelete operations to FS/S3A for DistCP

[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15191: Attachment: HADOOP-15191-001.patch > Add Private/Unstable BulkDelete operations to FS/S3A

[jira] [Commented] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338785#comment-16338785 ] Genmao Yu commented on HADOOP-14999: cc [~Sammi], take a review please > AliyunOSS: provide one

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338783#comment-16338783 ] Genmao Yu commented on HADOOP-15189: cc [~Sammi] I have upload 3 new patches to bachport 

[jira] [Assigned] (HADOOP-15191) Add Private/Unstable BulkDelete operations to FS/S3A for DistCP

[ https://issues.apache.org/jira/browse/HADOOP-15191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-15191: --- Assignee: Steve Loughran > Add Private/Unstable BulkDelete operations to FS/S3A

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338776#comment-16338776 ] Genmao Yu commented on HADOOP-15189: {code} Results : Tests run: 3640, Failures: 0, Errors: 0,

[jira] [Created] (HADOOP-15191) Add Private/Unstable BulkDelete operations to FS/S3A for DistCP

Steve Loughran created HADOOP-15191: --- Summary: Add Private/Unstable BulkDelete operations to FS/S3A for DistCP Key: HADOOP-15191 URL: https://issues.apache.org/jira/browse/HADOOP-15191 Project:

[jira] [Comment Edited] (HADOOP-14445) Delegation tokens are not shared between KMS instances

[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337925#comment-16337925 ] Xiao Chen edited comment on HADOOP-14445 at 1/25/18 5:07 AM: - Thanks for the

[jira] [Commented] (HADOOP-14918) remove the Local Dynamo DB test option

[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338735#comment-16338735 ] Mingliang Liu commented on HADOOP-14918: Yes we should switch {{TestDynamoDBMetadataStore}} to

[jira] [Commented] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338693#comment-16338693 ] genericqa commented on HADOOP-15168: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338661#comment-16338661 ] genericqa commented on HADOOP-15189: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338660#comment-16338660 ] genericqa commented on HADOOP-14999: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338644#comment-16338644 ] Bharat Viswanadham edited comment on HADOOP-15168 at 1/25/18 3:04 AM:

[jira] [Updated] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HADOOP-15168: Attachment: HADOOP-15168.01.patch > Add kdiag tool to hadoop command >

[jira] [Comment Edited] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338644#comment-16338644 ] Bharat Viswanadham edited comment on HADOOP-15168 at 1/25/18 2:54 AM:

[jira] [Commented] (HADOOP-14918) remove the Local Dynamo DB test option

[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338645#comment-16338645 ] Aaron Fabbri commented on HADOOP-14918: --- You should be able to just change it to an ITest and set

[jira] [Comment Edited] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338644#comment-16338644 ] Bharat Viswanadham edited comment on HADOOP-15168 at 1/25/18 2:50 AM:

[jira] [Commented] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338644#comment-16338644 ] Bharat Viswanadham commented on HADOOP-15168: - Hi [~hanishakoneru] I don't see, all the

[jira] [Commented] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338613#comment-16338613 ] Genmao Yu commented on HADOOP-14999: patch.007 fix "findbugs" issue > AliyunOSS: provide one

[jira] [Commented] (HADOOP-13761) S3Guard: implement retries for DDB failures and throttling; translate exceptions

[ https://issues.apache.org/jira/browse/HADOOP-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338609#comment-16338609 ] Aaron Fabbri commented on HADOOP-13761: --- {quote} Managed to break tests when working with a bucket

[jira] [Updated] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-14999: --- Attachment: HADOOP-14999.007.patch > AliyunOSS: provide one asynchronous multi-part based uploading

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: HADOOP-15189-branch-2.001.patch > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: (was: HADOOP-15189-branch-2.001.patch) > backport HADOOP-15039 to branch-2 and

[jira] [Commented] (HADOOP-14918) remove the Local Dynamo DB test option

[ https://issues.apache.org/jira/browse/HADOOP-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338413#comment-16338413 ] Aaron Fabbri commented on HADOOP-14918: --- Patch looks good except we want to keep

[jira] [Commented] (HADOOP-14946) S3Guard testPruneCommandCLI can fail in parallel runs

[ https://issues.apache.org/jira/browse/HADOOP-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338394#comment-16338394 ] Steve Loughran commented on HADOOP-14946: - Seen again. Another possible cause: sleep() time too

[jira] [Comment Edited] (HADOOP-15190) Use Jacoco to generate Unit Test coverage reports

[ https://issues.apache.org/jira/browse/HADOOP-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338381#comment-16338381 ] Allen Wittenauer edited comment on HADOOP-15190 at 1/24/18 10:59 PM: -

[jira] [Commented] (HADOOP-15190) Use Jacoco to generate Unit Test coverage reports

[ https://issues.apache.org/jira/browse/HADOOP-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338381#comment-16338381 ] Allen Wittenauer commented on HADOOP-15190: --- bq. Atlassian open-sourced clover last year so

[jira] [Comment Edited] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338079#comment-16338079 ] Hanisha Koneru edited comment on HADOOP-15168 at 1/24/18 7:30 PM: --

[jira] [Updated] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HADOOP-15168: Priority: Minor (was: Major) > Add kdiag tool to hadoop command >

[jira] [Comment Edited] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338079#comment-16338079 ] Hanisha Koneru edited comment on HADOOP-15168 at 1/24/18 7:24 PM: --

[jira] [Updated] (HADOOP-15121) Encounter NullPointerException when using DecayRpcScheduler

[ https://issues.apache.org/jira/browse/HADOOP-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HADOOP-15121: Resolution: Fixed Status: Resolved (was: Patch Available) > Encounter

[jira] [Updated] (HADOOP-15190) Use Jacoco to generate Unit Test coverage reports

[ https://issues.apache.org/jira/browse/HADOOP-15190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Xu updated HADOOP-15190: Attachment: Screen Shot 2018-01-24 01.JPG > Use Jacoco to generate Unit Test coverage reports >

[jira] [Created] (HADOOP-15190) Use Jacoco to generate Unit Test coverage reports

Duo Xu created HADOOP-15190: --- Summary: Use Jacoco to generate Unit Test coverage reports Key: HADOOP-15190 URL: https://issues.apache.org/jira/browse/HADOOP-15190 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HADOOP-15168: Issue Type: Improvement (was: Bug) > Add kdiag tool to hadoop command >

[jira] [Commented] (HADOOP-15168) Add kdiag tool to hadoop command

[ https://issues.apache.org/jira/browse/HADOOP-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338079#comment-16338079 ] Hanisha Koneru commented on HADOOP-15168: - Thanks [~bharatviswa] for the patch. LGTM. +1. > Add

[jira] [Commented] (HADOOP-15140) S3guard mistakes root URI without / as non-absolute path

[ https://issues.apache.org/jira/browse/HADOOP-15140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337946#comment-16337946 ] Steve Loughran commented on HADOOP-15140: - Sanjay. problem here is that I can take a valid

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337925#comment-16337925 ] Xiao Chen commented on HADOOP-14445: Thanks for the work here Rushabh, latest patch looks really

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337815#comment-16337815 ] genericqa commented on HADOOP-15189: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337795#comment-16337795 ] genericqa commented on HADOOP-15189: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337792#comment-16337792 ] genericqa commented on HADOOP-14999: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337763#comment-16337763 ] genericqa commented on HADOOP-15189: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337762#comment-16337762 ] genericqa commented on HADOOP-15189: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337698#comment-16337698 ] genericqa commented on HADOOP-15189: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337667#comment-16337667 ] Genmao Yu commented on HADOOP-14999: resubmit patch.006 to trigger PreCommit build > AliyunOSS:

[jira] [Updated] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-14999: --- Attachment: HADOOP-14999.006.patch > AliyunOSS: provide one asynchronous multi-part based uploading

[jira] [Updated] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-14999: --- Attachment: (was: HADOOP-14999.006.patch) > AliyunOSS: provide one asynchronous multi-part

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: HADOOP-15189-branch-3.0.001.patch > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: HADOOP-15189-branch-2.9.001.patch > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: HADOOP-15189-branch-2.001.patch > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: (was: HADOOP-15189-branch-2.9.001.patch) > backport HADOOP-15039 to branch-2 and

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: (was: HADOOP-15189-branch-2.001.patch) > backport HADOOP-15039 to branch-2 and

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Status: Patch Available (was: In Progress) > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: HADOOP-15189-branch-2.9.001.patch > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Updated] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-15189: --- Attachment: HADOOP-15189-branch-2.001.patch > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Commented] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337585#comment-16337585 ] genericqa commented on HADOOP-14999: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Work started] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

[ https://issues.apache.org/jira/browse/HADOOP-15189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-15189 started by Genmao Yu. -- > backport HADOOP-15039 to branch-2 and branch-3 >

[jira] [Created] (HADOOP-15189) backport HADOOP-15039 to branch-2 and branch-3

Genmao Yu created HADOOP-15189: -- Summary: backport HADOOP-15039 to branch-2 and branch-3 Key: HADOOP-15189 URL: https://issues.apache.org/jira/browse/HADOOP-15189 Project: Hadoop Common Issue

[jira] [Updated] (HADOOP-14999) AliyunOSS: provide one asynchronous multi-part based uploading mechanism

[ https://issues.apache.org/jira/browse/HADOOP-14999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Genmao Yu updated HADOOP-14999: --- Attachment: HADOOP-14999.006.patch > AliyunOSS: provide one asynchronous multi-part based uploading