[GitHub] [hadoop] ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265856195 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/x509/certifi

[GitHub] [hadoop] ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265856213 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/LongCodec.java #

[GitHub] [hadoop] ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265855876 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/x509/certifi

[GitHub] [hadoop] ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
ajayydv commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265855638 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/x509/certifi

[jira] [Commented] (HADOOP-16191) AliyunOSS: improvements for copyFile/copyDirectory and logging

2019-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793309#comment-16793309 ] Hadoop QA commented on HADOOP-16191: | (/) *{color:green}+1 overall{color}* | \\ \\

[jira] [Commented] (HADOOP-16182) Update abfs storage back-end with "close" flag when application is done writing to a file

2019-03-14 Thread Vishwajeet Dusane (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793307#comment-16793307 ] Vishwajeet Dusane commented on HADOOP-16182: Thank you [~DanielZhou] . [~st

[GitHub] [hadoop] hadoop-yetus commented on issue #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#issuecomment-473155720 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] bharatviswa504 merged pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-14 Thread GitBox
bharatviswa504 merged pull request #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on issue #610: [MAPREDUCE-7193] Review of CombineFile Code

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #610: [MAPREDUCE-7193] Review of CombineFile Code URL: https://github.com/apache/hadoop/pull/610#issuecomment-473149253 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:---

[jira] [Updated] (HADOOP-16191) AliyunOSS: improvements for copyFile/copyDirectory and logging

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Status: Patch Available (was: Open) > AliyunOSS: improvements for copyFile/copyDirectory and logging >

[GitHub] [hadoop] xiaoyuyao commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
xiaoyuyao commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-473147758 Thanks @ajayydv for the update. We are almost there. Just few last issues as commented inline. --

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265840907 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/security/OzoneDel

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265840558 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/utils/db/LongCodec.java

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265840441 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/x509/certi

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265840287 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/x509/certi

[GitHub] [hadoop] hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#issuecomment-473139432 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|--

[jira] [Updated] (HADOOP-16191) AliyunOSS: improvements for copyFile/copyDirectory and logging

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Description: Returned status of copyFile and copyDirectory are ignored. It's OK most of the time. {cod

[jira] [Updated] (HADOOP-16191) AliyunOSS: improvements for copyFile/copyDirectory and logging

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Description: Returned status of copyFile and copyDirectory are ignored. It's OK most of the time. {cod

[jira] [Updated] (HADOOP-16191) AliyunOSS: improvements for copyFile/copyDirectory and logging

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Description: Returned status of copyFile and copyDirectory are ignored. It's OK most of the time. {cod

[jira] [Updated] (HADOOP-16191) AliyunOSS: improvements for copyFile/copyDirectory and logging

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Summary: AliyunOSS: improvements for copyFile/copyDirectory and logging (was: AliyunOSS: returned stat

[jira] [Updated] (HADOOP-16191) AliyunOSS: returned statuses of copyFile and copyDirectory are ignored

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Attachment: HADOOP-16191.001.patch > AliyunOSS: returned statuses of copyFile and copyDirectory are ign

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-473132399 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] hadoop-yetus commented on issue #612: HDDS-1285. Implement actions need to be taken after chill mode exit w…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #612: HDDS-1285. Implement actions need to be taken after chill mode exit w… URL: https://github.com/apache/hadoop/pull/612#issuecomment-473129276 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|---

[GitHub] [hadoop] hadoop-yetus commented on issue #612: HDDS-1285. Implement actions need to be taken after chill mode exit w…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #612: HDDS-1285. Implement actions need to be taken after chill mode exit w… URL: https://github.com/apache/hadoop/pull/612#issuecomment-473128833 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|---

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-473123532 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] bharatviswa504 merged pull request #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters

2019-03-14 Thread GitBox
bharatviswa504 merged pull request #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters URL: https://github.com/apache/hadoop/pull/611 This is an automated message from the Apache Git

[GitHub] [hadoop] hadoop-yetus commented on issue #610: [MAPREDUCE-7193] Review of CombineFile Code

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #610: [MAPREDUCE-7193] Review of CombineFile Code URL: https://github.com/apache/hadoop/pull/610#issuecomment-473111002 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:---

[GitHub] [hadoop] hadoop-yetus commented on a change in pull request #610: [MAPREDUCE-7193] Review of CombineFile Code

2019-03-14 Thread GitBox
hadoop-yetus commented on a change in pull request #610: [MAPREDUCE-7193] Review of CombineFile Code URL: https://github.com/apache/hadoop/pull/610#discussion_r265811073 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/ap

[GitHub] [hadoop] bharatviswa504 opened a new pull request #612: HDDS-1285. Implement actions need to be taken after chill mode exit w…

2019-03-14 Thread GitBox
bharatviswa504 opened a new pull request #612: HDDS-1285. Implement actions need to be taken after chill mode exit w… URL: https://github.com/apache/hadoop/pull/612 …ait time. This is an automated message from the Apache Git

[GitHub] [hadoop] hadoop-yetus commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters URL: https://github.com/apache/hadoop/pull/611#issuecomment-473107850 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment

[GitHub] [hadoop] hadoop-yetus commented on issue #610: [MAPREDUCE-7193] Review of CombineFile Code

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #610: [MAPREDUCE-7193] Review of CombineFile Code URL: https://github.com/apache/hadoop/pull/610#issuecomment-473107160 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:---

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-473105862 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] hadoop-yetus commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters URL: https://github.com/apache/hadoop/pull/611#issuecomment-473105531 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment

[jira] [Commented] (HADOOP-13656) fs -expunge to take a filesystem

2019-03-14 Thread Siyao Meng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793153#comment-16793153 ] Siyao Meng commented on HADOOP-13656: - Thanks for the patch. Some suggestions: 1.

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-473097706 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] hadoop-yetus commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters URL: https://github.com/apache/hadoop/pull/611#issuecomment-473088240 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment

[GitHub] [hadoop] bharatviswa504 commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-14 Thread GitBox
bharatviswa504 commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#issuecomment-473076170 +1 LGTM. Pending jenkins This is an automated messag

[GitHub] [hadoop] bharatviswa504 commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters

2019-03-14 Thread GitBox
bharatviswa504 commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters URL: https://github.com/apache/hadoop/pull/611#issuecomment-473074050 LGTM. Can we add a UT for this change? --

[GitHub] [hadoop] vivekratnavel commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters

2019-03-14 Thread GitBox
vivekratnavel commented on issue #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters URL: https://github.com/apache/hadoop/pull/611#issuecomment-473073044 @bharatviswa504 @swagle @avijayanhwx @elek -

[GitHub] [hadoop] vivekratnavel opened a new pull request #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters

2019-03-14 Thread GitBox
vivekratnavel opened a new pull request #611: HDDS-1265. "ozone sh s3 getsecret" throws Null Pointer Exception for unsecured clusters URL: https://github.com/apache/hadoop/pull/611 "ozone sh s3 getsecret" command throws a Null Pointer Exception. This patch fixes it by showing the fol

[jira] [Commented] (HADOOP-16188) s3a rename failed during copy, "Unable to copy part" + 200 error code

2019-03-14 Thread Aaron Fabbri (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793058#comment-16793058 ] Aaron Fabbri commented on HADOOP-16188: --- uhhh.. I'm shaking my head here. S3 is s

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265761945 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hado

[GitHub] [hadoop] hadoop-yetus commented on issue #609: HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #609: HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU URL: https://github.com/apache/hadoop/pull/609#issuecomment-473056442 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | C

[GitHub] [hadoop] ajayydv commented on issue #605: HDDS-1283. Fix the dynamic documentation of basic s3 client usage

2019-03-14 Thread GitBox
ajayydv commented on issue #605: HDDS-1283. Fix the dynamic documentation of basic s3 client usage URL: https://github.com/apache/hadoop/pull/605#issuecomment-473054101 +1 This is an automated message from the Apache Git Serv

[GitHub] [hadoop] ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
ajayydv commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265756537 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#discussion_r265755116 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/security/token/Bloc

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265752989 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoo

[GitHub] [hadoop] BELUGABEHR opened a new pull request #610: [MAPREDUCE-7193] Review of CombineFile Code

2019-03-14 Thread GitBox
BELUGABEHR opened a new pull request #610: [MAPREDUCE-7193] Review of CombineFile Code URL: https://github.com/apache/hadoop/pull/610 This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [hadoop] ajfabbri commented on a change in pull request #575: HADOOP-13327 Output Stream Specification

2019-03-14 Thread GitBox
ajfabbri commented on a change in pull request #575: HADOOP-13327 Output Stream Specification URL: https://github.com/apache/hadoop/pull/575#discussion_r265749117 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/contract/AbstractFSContractTestBas

[jira] [Updated] (HADOOP-16185) S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16185: Affects Version/s: (was: 3.1.0) 3.3.0 > S3Guard: Optimize perf

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793031#comment-16793031 ] Steve Loughran commented on HADOOP-15999: - really close to getting in, ran lots

[GitHub] [hadoop] ajfabbri commented on issue #577: HADOOP-16058 S3A to support terasort

2019-03-14 Thread GitBox
ajfabbri commented on issue #577: HADOOP-16058 S3A to support terasort URL: https://github.com/apache/hadoop/pull/577#issuecomment-473040233 pulled your branch and ran into other compile issues ``` [ERROR] Errors: [ERROR] TestZKSignerSecretProvider.testMultiple1:247->testMultiple:30

[jira] [Commented] (HADOOP-16185) S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16793019#comment-16793019 ] Steve Loughran commented on HADOOP-16185: - thanks for filing this. > S3Guard:

[jira] [Updated] (HADOOP-16185) S3Guard: Optimize performance of handling OOB operations in non-authoritative mode

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16185: Priority: Minor (was: Major) > S3Guard: Optimize performance of handling OOB operations

[GitHub] [hadoop] steveloughran commented on issue #609: HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU

2019-03-14 Thread GitBox
steveloughran commented on issue #609: HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU URL: https://github.com/apache/hadoop/pull/609#issuecomment-473036424 Tested: S3 ireland. Remember to use -Dscale when running this test suite, even though th

[jira] [Assigned] (HADOOP-16193) add extra S3A MPU test to see what happens if a file is created during the MPU

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-16193: --- Assignee: Steve Loughran > add extra S3A MPU test to see what happens if a file is

[GitHub] [hadoop] steveloughran opened a new pull request #609: HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU

2019-03-14 Thread GitBox
steveloughran opened a new pull request #609: HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU URL: https://github.com/apache/hadoop/pull/609 HADOOP-16193. add extra S3A MPU test to see what happens if a file is created during the MPU

[jira] [Updated] (HADOOP-16193) add extra S3A MPU test to see what happens if a file is created during the MPU

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-16193: Summary: add extra S3A MPU test to see what happens if a file is created during the MPU

[jira] [Created] (HADOOP-16193) add extra S3A MPU test to see what happens if a file is created then deleted mid-write

2019-03-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16193: --- Summary: add extra S3A MPU test to see what happens if a file is created then deleted mid-write Key: HADOOP-16193 URL: https://issues.apache.org/jira/browse/HADOOP-16193

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15625: Resolution: Fixed Status: Resolved (was: Patch Available) Patch backported into

[jira] [Updated] (HADOOP-15625) S3A input stream to use etags/version number to detect changed source files

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15625: Fix Version/s: 3.2.1 > S3A input stream to use etags/version number to detect changed sou

[GitHub] [hadoop] ajfabbri commented on issue #577: HADOOP-16058 S3A to support terasort

2019-03-14 Thread GitBox
ajfabbri commented on issue #577: HADOOP-16058 S3A to support terasort URL: https://github.com/apache/hadoop/pull/577#issuecomment-473030090 +1 LGTM but have not tested yet. Working on that now. This is an automated message fr

[GitHub] [hadoop] ajfabbri commented on issue #577: HADOOP-16058 S3A to support terasort

2019-03-14 Thread GitBox
ajfabbri commented on issue #577: HADOOP-16058 S3A to support terasort URL: https://github.com/apache/hadoop/pull/577#issuecomment-473029760 How do you usually apply these pull requests locally for testing? Anything easier than (1) adding remote (2) checkout branch from new remote, etc.?

[jira] [Commented] (HADOOP-16192) CallQueue backoff bug fixes: doesn't perform backoff when add() is used, and doesn't update backoff when refreshed

2019-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792965#comment-16792965 ] Hadoop QA commented on HADOOP-16192: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-473010068 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-473009100 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] vivekratnavel commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations

2019-03-14 Thread GitBox
vivekratnavel commented on issue #579: HDDS-761. Create S3 subcommand to run S3 related operations URL: https://github.com/apache/hadoop/pull/579#issuecomment-473008126 Failures are unrelated to this patch This is an automate

[GitHub] [hadoop] hadoop-yetus commented on issue #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#issuecomment-473005533 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime |

[GitHub] [hadoop] hadoop-yetus commented on issue #585: HDDS-1138. Ozone Client should avoid talking to SCM directly

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #585: HDDS-1138. Ozone Client should avoid talking to SCM directly URL: https://github.com/apache/hadoop/pull/585#issuecomment-472989637 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|-

[GitHub] [hadoop] ajfabbri commented on a change in pull request #575: HADOOP-13327 Output Stream Specification

2019-03-14 Thread GitBox
ajfabbri commented on a change in pull request #575: HADOOP-13327 Output Stream Specification URL: https://github.com/apache/hadoop/pull/575#discussion_r265692719 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/StreamStateModel.java ##

[GitHub] [hadoop] ajfabbri commented on a change in pull request #575: HADOOP-13327 Output Stream Specification

2019-03-14 Thread GitBox
ajfabbri commented on a change in pull request #575: HADOOP-13327 Output Stream Specification URL: https://github.com/apache/hadoop/pull/575#discussion_r265691746 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/StreamStateModel.java ##

[jira] [Commented] (HADOOP-16186) NPE in ITestS3AFileSystemContract teardown in DynamoDBMetadataStore.lambda$listChildren

2019-03-14 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792902#comment-16792902 ] Gabor Bota commented on HADOOP-16186: - {quote}There's clearly some codepath which c

[jira] [Updated] (HADOOP-16192) CallQueue backoff bug fixes: doesn't perform backoff when add() is used, and doesn't update backoff when refreshed

2019-03-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16192: - Attachment: HADOOP-16192.000.patch > CallQueue backoff bug fixes: doesn't perform backoff when

[jira] [Updated] (HADOOP-16192) CallQueue backoff bug fixes: doesn't perform backoff when add() is used, and doesn't update backoff when refreshed

2019-03-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16192: - Description: The {{CallQueueManager}} has a mechanism to enforce backoff when various criteria

[jira] [Updated] (HADOOP-16192) CallQueue backoff bug fixes: doesn't perform backoff when add() is used, and doesn't update backoff when refreshed

2019-03-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16192: - Status: Patch Available (was: In Progress) > CallQueue backoff bug fixes: doesn't perform back

[jira] [Updated] (HADOOP-16192) CallQueue backoff bug fixes: doesn't perform backoff when add() is used, and doesn't update backoff when refreshed

2019-03-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HADOOP-16192: - Summary: CallQueue backoff bug fixes: doesn't perform backoff when add() is used, and doesn't u

[jira] [Work started] (HADOOP-16192) CallQueue doesn't perform backoff when add() is used

2019-03-14 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-16192 started by Erik Krogen. > CallQueue doesn't perform backoff when add() is used > -

[jira] [Created] (HADOOP-16192) CallQueue doesn't perform backoff when add() is used

2019-03-14 Thread Erik Krogen (JIRA)
Erik Krogen created HADOOP-16192: Summary: CallQueue doesn't perform backoff when add() is used Key: HADOOP-16192 URL: https://issues.apache.org/jira/browse/HADOOP-16192 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on issue #608: HDDS-1284. Adjust default values of pipline recovery for more resilient service restart

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #608: HDDS-1284. Adjust default values of pipline recovery for more resilient service restart URL: https://github.com/apache/hadoop/pull/608#issuecomment-472963511 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment

[GitHub] [hadoop] xiaoyuyao commented on issue #585: HDDS-1138. Ozone Client should avoid talking to SCM directly

2019-03-14 Thread GitBox
xiaoyuyao commented on issue #585: HDDS-1138. Ozone Client should avoid talking to SCM directly URL: https://github.com/apache/hadoop/pull/585#issuecomment-472959581 Rebase after the following two conflicting changes: HDDS-1220. KeyManager#openKey should release the bucket lock before do

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265665773 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hado

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265665546 ## File path: hadoop-ozone/common/src/main/proto/OzoneManagerProt

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265665217 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoo

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265665005 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoo

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265664265 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoo

[GitHub] [hadoop] xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao.

2019-03-14 Thread GitBox
xiaoyuyao commented on a change in pull request #594: HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. URL: https://github.com/apache/hadoop/pull/594#discussion_r265663195 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoo

[GitHub] [hadoop] hadoop-yetus commented on issue #607: HADOOP-15999. S3Guard: Better support for out-of-band operations

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #607: HADOOP-15999. S3Guard: Better support for out-of-band operations URL: https://github.com/apache/hadoop/pull/607#issuecomment-472953344 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[jira] [Updated] (HADOOP-16191) AliyunOSS: returned statuses of copyFile and copyDirectory are ignored

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Summary: AliyunOSS: returned statuses of copyFile and copyDirectory are ignored (was: AliyunOSS: retur

[GitHub] [hadoop] hadoop-yetus commented on issue #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request URL: https://github.com/apache/hadoop/pull/606#issuecomment-472943946 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Co

[jira] [Updated] (HADOOP-16191) AliyunOSS: returned status of copyFile and copyDirectory are ignored

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Description: Returned status of copyFile and copyDirectory are ignored. It's OK most of the time. {cod

[jira] [Updated] (HADOOP-16191) AliyunOSS: returned status of copyFile and copyDirectory are ignored

2019-03-14 Thread wujinhu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wujinhu updated HADOOP-16191: - Issue Type: Sub-task (was: Task) Parent: HADOOP-13377 > AliyunOSS: returned status of copyFile

[jira] [Created] (HADOOP-16191) AliyunOSS: returned status of copyFile and copyDirectory are ignored

2019-03-14 Thread wujinhu (JIRA)
wujinhu created HADOOP-16191: Summary: AliyunOSS: returned status of copyFile and copyDirectory are ignored Key: HADOOP-16191 URL: https://issues.apache.org/jira/browse/HADOOP-16191 Project: Hadoop Common

[GitHub] [hadoop] elek opened a new pull request #608: HDDS-1284. Adjust default values of pipline recovery for more resilient service restart

2019-03-14 Thread GitBox
elek opened a new pull request #608: HDDS-1284. Adjust default values of pipline recovery for more resilient service restart URL: https://github.com/apache/hadoop/pull/608 As of now we have a following algorithm to handle node failures: 1. In case of a missing node the leader of the

[GitHub] [hadoop] hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat…

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #601: HDDS-1119. DN get OM certificate from SCM CA for block token validat… URL: https://github.com/apache/hadoop/pull/601#issuecomment-472936643 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] hadoop-yetus commented on issue #605: HDDS-1283. Fix the dynamic documentation of basic s3 client usage

2019-03-14 Thread GitBox
hadoop-yetus commented on issue #605: HDDS-1283. Fix the dynamic documentation of basic s3 client usage URL: https://github.com/apache/hadoop/pull/605#issuecomment-472929153 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|

[GitHub] [hadoop] bgaborg opened a new pull request #607: HADOOP-15999. S3Guard: Better support for out-of-band operations

2019-03-14 Thread GitBox
bgaborg opened a new pull request #607: HADOOP-15999. S3Guard: Better support for out-of-band operations URL: https://github.com/apache/hadoop/pull/607 This is an automated message from the Apache Git Service. To respond to

[jira] [Created] (HADOOP-16189) S3A copy/rename of large files to be parallelized as a multipart operation

2019-03-14 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-16189: --- Summary: S3A copy/rename of large files to be parallelized as a multipart operation Key: HADOOP-16189 URL: https://issues.apache.org/jira/browse/HADOOP-16189 Pr

[jira] [Commented] (HADOOP-15999) S3Guard: Better support for out-of-band operations

2019-03-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16792794#comment-16792794 ] Steve Loughran commented on HADOOP-15999: - bq. (note to myself: if I use low d

[GitHub] [hadoop] steveloughran commented on issue #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request

2019-03-14 Thread GitBox
steveloughran commented on issue #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request URL: https://github.com/apache/hadoop/pull/606#issuecomment-472916788 Initial PR: untested Th

[GitHub] [hadoop] steveloughran opened a new pull request #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request

2019-03-14 Thread GitBox
steveloughran opened a new pull request #606: HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request URL: https://github.com/apache/hadoop/pull/606 HADOOP-16190. S3A copyFile operation to include source versionID or etag in the copy request This

  1   2   >