[jira] [Created] (HADOOP-17436) envtoconf broken for .conf and few other formats

2020-12-15 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HADOOP-17436: - Summary: envtoconf broken for .conf and few other formats Key: HADOOP-17436 URL: https://issues.apache.org/jira/browse/HADOOP-17436 Project: Hadoop Common

[jira] [Updated] (HADOOP-17435) Remove Hadoop 2.9.2 from the download page

2020-12-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17435: --- Status: Patch Available (was: Open) > Remove Hadoop 2.9.2 from the download page > ---

[jira] [Updated] (HADOOP-17435) Remove Hadoop 2.9.2 from the download page

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17435: Labels: pull-request-available (was: ) > Remove Hadoop 2.9.2 from the download page > --

[jira] [Assigned] (HADOOP-17435) Remove Hadoop 2.9.2 from the download page

2020-12-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-17435: -- Assignee: Akira Ajisaka > Remove Hadoop 2.9.2 from the download page > -

[jira] [Commented] (HADOOP-17435) Remove Hadoop 2.9.2 from the download page

2020-12-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250144#comment-17250144 ] Akira Ajisaka commented on HADOOP-17435: After it is removed from the download

[jira] [Created] (HADOOP-17435) Remove Hadoop 2.9.2 from the download page

2020-12-15 Thread Akira Ajisaka (Jira)
Akira Ajisaka created HADOOP-17435: -- Summary: Remove Hadoop 2.9.2 from the download page Key: HADOOP-17435 URL: https://issues.apache.org/jira/browse/HADOOP-17435 Project: Hadoop Common Issu

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-745807832 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] sumangala-patki commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2020-12-15 Thread GitBox
sumangala-patki commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-745776042 TEST RESULTS HNS Account Location: East US 2 NonHNS Account Location: East US 2, Central US ``` HNS OAuth [INFO] Tests run: 97, Failures: 0, Erro

[jira] [Work logged] (HADOOP-17430) There is no way to clear Text bytes now

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17430?focusedWorklogId=524831&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524831 ] ASF GitHub Bot logged work on HADOOP-17430: --- Author: ASF GitHub B

[GitHub] [hadoop] ayushtkn commented on pull request #2545: HADOOP-17430. Add clear bytes logic for hadoop Text

2020-12-15 Thread GitBox
ayushtkn commented on pull request #2545: URL: https://github.com/apache/hadoop/pull/2545#issuecomment-745762893 Thanx @dgzdot for the work here. Can you take care of the checkstyle warnings https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2545/2/artifact/out/diff-checkstyl

[GitHub] [hadoop] ayushtkn commented on pull request #2533: HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout

2020-12-15 Thread GitBox
ayushtkn commented on pull request #2533: URL: https://github.com/apache/hadoop/pull/2533#issuecomment-745759540 Thanx @jojochuang for the work here. The PR seems to include two Jira's, I think the timeout stuff is sufficient alone, If so, Can you update the PR

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524825&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524825 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543916656 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524824&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524824 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543919524 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524823&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524823 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543916656 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524819&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524819 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543903666 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524818&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524818 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543900358 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524817&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524817 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543899390 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524815&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524815 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543887310 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524814&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524814 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524813&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524813 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543887863 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543887310 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524810&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524810 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] snvijaya commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
snvijaya commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543881568 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +231,127 @@ private int r

[jira] [Comment Edited] (HADOOP-17412) When `fs.s3a.connection.ssl.enabled=true`, Error when visit S3A with AKSK

2020-12-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250065#comment-17250065 ] angerszhu edited comment on HADOOP-17412 at 12/16/20, 2:50 AM: --

[jira] [Commented] (HADOOP-17412) When `fs.s3a.connection.ssl.enabled=true`, Error when visit S3A with AKSK

2020-12-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250065#comment-17250065 ] angerszhu commented on HADOOP-17412:   set  below config can run well. fs.s3a.p

[jira] [Comment Edited] (HADOOP-17017) S3A client retries on SSL Auth exceptions triggered by "." bucket names

2020-12-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250064#comment-17250064 ] angerszhu edited comment on HADOOP-17017 at 12/16/20, 2:48 AM: --

[jira] [Commented] (HADOOP-17017) S3A client retries on SSL Auth exceptions triggered by "." bucket names

2020-12-15 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250064#comment-17250064 ] angerszhu commented on HADOOP-17017: [~ste...@apache.org] set  below config can al

[jira] [Updated] (HADOOP-17068) client fails forever when namenode ipaddr changed

2020-12-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17068: - Fix Version/s: 2.10.2 > client fails forever when namenode ipaddr changed > ---

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524745&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524745 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-745606706 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #2552: YARN-10534 Enable runC container transformations

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2552: URL: https://github.com/apache/hadoop/pull/2552#issuecomment-745602700 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Commented] (HADOOP-17068) client fails forever when namenode ipaddr changed

2020-12-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249981#comment-17249981 ] Wei-Chiu Chuang commented on HADOOP-17068: -- The patch applies cleanly in lower

[jira] [Updated] (HADOOP-17068) client fails forever when namenode ipaddr changed

2020-12-15 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-17068: - Fix Version/s: 3.2.3 3.1.5 3.3.1 > client fails f

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524679&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524679 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-15 Thread GitBox
steveloughran commented on pull request #2553: URL: https://github.com/apache/hadoop/pull/2553#issuecomment-745533557 Test failures in tests which are seeing 1 too many LIST calls. I think the wiring up of list duration and metrics is causing this; had something similar with object metadat

[GitHub] [hadoop] mbsharp commented on a change in pull request #2552: YARN-10534 Enable runC container transformations

2020-12-15 Thread GitBox
mbsharp commented on a change in pull request #2552: URL: https://github.com/apache/hadoop/pull/2552#discussion_r543630350 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java ## @@ -2158,6 +2158,10 @@ p

[GitHub] [hadoop] mbsharp commented on a change in pull request #2552: YARN-10534 Enable runC container transformations

2020-12-15 Thread GitBox
mbsharp commented on a change in pull request #2552: URL: https://github.com/apache/hadoop/pull/2552#discussion_r543622533 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containerm

[GitHub] [hadoop] hadoop-yetus commented on pull request #2552: YARN-10534 Enable runC container transformations

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2552: URL: https://github.com/apache/hadoop/pull/2552#issuecomment-745509624 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-745500153 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524625&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524625 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran opened a new pull request #2553: HADOOP-17271. S3A to support IOStatistics

2020-12-15 Thread GitBox
steveloughran opened a new pull request #2553: URL: https://github.com/apache/hadoop/pull/2553 This is the rebase of #2324 #2323 with the following changes We're into the danger zone here as I'm adding more features; to get this in it needs to be merged and then I can add as ne

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524609&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524609 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524608&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524608 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran closed pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-12-15 Thread GitBox
steveloughran closed pull request #2324: URL: https://github.com/apache/hadoop/pull/2324 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop] steveloughran commented on pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-12-15 Thread GitBox
steveloughran commented on pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#issuecomment-745475829 Going to close this PR and re-open a new one rebased to trunk. Sorry This is an automated message from the

[GitHub] [hadoop] rahuldutta90 commented on a change in pull request #2551: ADLS Gen1: Updating gen1 SDK version from 2.3.6 to 2.3.9

2020-12-15 Thread GitBox
rahuldutta90 commented on a change in pull request #2551: URL: https://github.com/apache/hadoop/pull/2551#discussion_r543571592 ## File path: hadoop-tools/hadoop-azure-datalake/pom.xml ## @@ -166,5 +166,12 @@ test test-jar + + + org.wildfly.openssl

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524596&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524596 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524593&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524593 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524595&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524595 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-12-15 Thread GitBox
steveloughran commented on a change in pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#discussion_r543563450 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AInstrumentation.java ## @@ -1017,68 +1198,63 @@ void blockUploadComp

[jira] [Work logged] (HADOOP-17271) S3A statistics to support IOStatistics

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17271?focusedWorklogId=524594&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524594 ] ASF GitHub Bot logged work on HADOOP-17271: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-12-15 Thread GitBox
steveloughran commented on a change in pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#discussion_r543563337 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AInstrumentation.java ## @@ -1017,68 +1198,63 @@ void blockUploadComp

[GitHub] [hadoop] steveloughran commented on a change in pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-12-15 Thread GitBox
steveloughran commented on a change in pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#discussion_r543563161 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AInstrumentation.java ## @@ -1017,68 +1198,63 @@ void blockUploadComp

[GitHub] [hadoop] steveloughran commented on a change in pull request #2324: HADOOP-17271. S3A statistics to support IOStatistics

2020-12-15 Thread GitBox
steveloughran commented on a change in pull request #2324: URL: https://github.com/apache/hadoop/pull/2324#discussion_r543562938 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/DefaultS3ClientFactory.java ## @@ -72,36 +99,123 @@ public AmazonS3 cre

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=524592&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524592 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran edited a comment on pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-12-15 Thread GitBox
steveloughran edited a comment on pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#issuecomment-745459150 Closing as it's impossible to maintain the interface and impl branches. The combined -common and -aws changes make for a bigger pr, but each patch has gone in separa

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=524591&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524591 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-16830) Add public IOStatistics API

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16830?focusedWorklogId=524590&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524590 ] ASF GitHub Bot logged work on HADOOP-16830: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran closed pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-12-15 Thread GitBox
steveloughran closed pull request #2323: URL: https://github.com/apache/hadoop/pull/2323 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop] steveloughran commented on pull request #2323: HADOOP-16830. Add public IOStatistics API.

2020-12-15 Thread GitBox
steveloughran commented on pull request #2323: URL: https://github.com/apache/hadoop/pull/2323#issuecomment-745459150 Closing as nobody was reviewing this and its impossible to maintain the interface and impl branches. The combined -common and -aws changes make for a bigger pr, but each pa

[jira] [Created] (HADOOP-17434) Improve S3A upload statistics collection from ProgressEvent callbacks

2020-12-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-17434: --- Summary: Improve S3A upload statistics collection from ProgressEvent callbacks Key: HADOOP-17434 URL: https://issues.apache.org/jira/browse/HADOOP-17434 Project

[GitHub] [hadoop] hadoop-yetus commented on pull request #2551: ADLS Gen1: Updating gen1 SDK version from 2.3.6 to 2.3.9

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2551: URL: https://github.com/apache/hadoop/pull/2551#issuecomment-745429338 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] insideo commented on a change in pull request #2552: YARN-10534 Enable runC container transformations

2020-12-15 Thread GitBox
insideo commented on a change in pull request #2552: URL: https://github.com/apache/hadoop/pull/2552#discussion_r543515365 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containerm

[GitHub] [hadoop] insideo commented on a change in pull request #2552: YARN-10534 Enable runC container transformations

2020-12-15 Thread GitBox
insideo commented on a change in pull request #2552: URL: https://github.com/apache/hadoop/pull/2552#discussion_r543514752 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java ## @@ -2158,6 +2158,10 @@ p

[GitHub] [hadoop] mbsharp opened a new pull request #2552: YARN-10534 Enable runC container transformations

2020-12-15 Thread GitBox
mbsharp opened a new pull request #2552: URL: https://github.com/apache/hadoop/pull/2552 https://issues.apache.org/jira/browse/YARN-10534 Adding an optional runC container transformer plugin, with an example kerberos transformation and tests. ---

[GitHub] [hadoop] bilaharith commented on a change in pull request #2551: ADLS Gen1: Updating gen1 SDK version from 2.3.6 to 2.3.9

2020-12-15 Thread GitBox
bilaharith commented on a change in pull request #2551: URL: https://github.com/apache/hadoop/pull/2551#discussion_r543486228 ## File path: hadoop-tools/hadoop-azure-datalake/pom.xml ## @@ -166,5 +166,12 @@ test test-jar + + + org.wildfly.openssl +

[GitHub] [hadoop] vinaysbadami commented on a change in pull request #2551: ADLS Gen1: Updating gen1 SDK version from 2.3.6 to 2.3.9

2020-12-15 Thread GitBox
vinaysbadami commented on a change in pull request #2551: URL: https://github.com/apache/hadoop/pull/2551#discussion_r543473857 ## File path: hadoop-tools/hadoop-azure-datalake/pom.xml ## @@ -166,5 +166,12 @@ test test-jar + + + org.wildfly.openssl

[GitHub] [hadoop] bilaharith opened a new pull request #2551: ADLS Gen1: Updating gen1 SDK version from 2.3.6 to 2.3.9

2020-12-15 Thread GitBox
bilaharith opened a new pull request #2551: URL: https://github.com/apache/hadoop/pull/2551 Updating gen1 SDK version from 2.3.6 to 2.3.9 **Before the change** [INFO] Results: [INFO] [ERROR] Failures: [ERROR] TestAdlContractRenameLive>AbstractContractRenameTest.te

[jira] [Work logged] (HADOOP-15984) Update jersey from 1.19 to 2.x

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15984?focusedWorklogId=524476&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524476 ] ASF GitHub Bot logged work on HADOOP-15984: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #763: [WIP] HADOOP-15984. Update jersey from 1.19 to 2.x

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #763: URL: https://github.com/apache/hadoop/pull/763#issuecomment-745334845 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok:

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=524421&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524421 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub B

[GitHub] [hadoop] tasanuma commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-12-15 Thread GitBox
tasanuma commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-745293902 @amahussein What do you think about it? This is an automated message from the Apache Git Service. To respond to

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=524414&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524414 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub B

[GitHub] [hadoop] tasanuma commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-12-15 Thread GitBox
tasanuma commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-745286856 This PR ran Jenkins 4 times. The best is 25 failures and the worst is 274 failures. According to some of the latest result of QBT, the best is 17 failures([#349](https://

[jira] [Work logged] (HADOOP-17224) Install Intel ISA-L library in Dockerfile

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17224?focusedWorklogId=524404&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524404 ] ASF GitHub Bot logged work on HADOOP-17224: --- Author: ASF GitHub B

[GitHub] [hadoop] iwasakims commented on pull request #2537: HADOOP-17224. Install Intel ISA-L library in Dockerfile.

2020-12-15 Thread GitBox
iwasakims commented on pull request #2537: URL: https://github.com/apache/hadoop/pull/2537#issuecomment-745279343 All OOMs are "unable to create new native thread" indicating ulimit or resource shortage to create LWP. The first OOM is in TestJvmMetrics in hadoop-common. If ISA-L is related

[GitHub] [hadoop] hadoop-yetus commented on pull request #2550: MAPREDUCE-7313. History file should move after conf file

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2550: URL: https://github.com/apache/hadoop/pull/2550#issuecomment-745204044 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524352&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524352 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#issuecomment-745199325 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Commented] (HADOOP-16492) Support HuaweiCloud Object Storage as a Hadoop Backend File System

2020-12-15 Thread Junping Du (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17249601#comment-17249601 ] Junping Du commented on HADOOP-16492: - bq. Junping Du could look into this, as you

[jira] [Updated] (HADOOP-15691) Add PathCapabilities to FS and FC to complement StreamCapabilities

2020-12-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HADOOP-15691: - Fix Version/s: 3.2.3 3.2.2 Add fix version 3.2.2 + 3.2.3, Please update fix

[GitHub] [hadoop] Deegue opened a new pull request #2550: MAPREDUCE-7313. History file should move after conf file

2020-12-15 Thread GitBox
Deegue opened a new pull request #2550: URL: https://github.com/apache/hadoop/pull/2550 History Server searches applications by visiting `history file`. If we move `history file` to `/done` before `conf file`, at the same time, stop the History Server, however, `conf file` is still in `/in

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524321&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524321 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524320&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524320 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] bilaharith commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
bilaharith commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543157634 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +229,120 @@ private int

[GitHub] [hadoop] bilaharith commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
bilaharith commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543157560 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +229,120 @@ private int

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524319&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524319 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] bilaharith commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
bilaharith commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543156538 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -206,11 +229,120 @@ private int

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524318&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524318 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

[GitHub] [hadoop] bilaharith commented on a change in pull request #2464: HADOOP-17347. ABFS: Read optimizations

2020-12-15 Thread GitBox
bilaharith commented on a change in pull request #2464: URL: https://github.com/apache/hadoop/pull/2464#discussion_r543156111 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsInputStream.java ## @@ -46,6 +50,7 @@ public class Ab

[GitHub] [hadoop] hadoop-yetus commented on pull request #2549: Hadoop 17428. ABFS: Implementation for getContentSummary

2020-12-15 Thread GitBox
hadoop-yetus commented on pull request #2549: URL: https://github.com/apache/hadoop/pull/2549#issuecomment-745138292 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17347) ABFS: Read optimizations

2020-12-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?focusedWorklogId=524304&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524304 ] ASF GitHub Bot logged work on HADOOP-17347: --- Author: ASF GitHub B

  1   2   >