[GitHub] [hadoop] tasanuma commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
tasanuma commented on PR #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1107352301 Merged. Thanks for your contribution, @cndaimin. Thanks for your review, @tomscut. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] tasanuma merged pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
tasanuma merged PR #4101: URL: https://github.com/apache/hadoop/pull/4101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

[GitHub] [hadoop] tasanuma commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
tasanuma commented on PR #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1107346064 @cndaimin Thanks for sharing the information about your practice, and updating PR. @tomscut Thanks for your review. Now I'm +1 on this PR. -- This is an automated message from the

[GitHub] [hadoop] tomscut commented on pull request #4210: HDFS-16552. Fix NPE for TestBlockManager

2022-04-22 Thread GitBox
tomscut commented on PR #4210: URL: https://github.com/apache/hadoop/pull/4210#issuecomment-110737 Thank you @tasanuma . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] tasanuma commented on pull request #4210: HDFS-16552. Fix NPE for TestBlockManager

2022-04-22 Thread GitBox
tasanuma commented on PR #4210: URL: https://github.com/apache/hadoop/pull/4210#issuecomment-1107342992 Thanks for fixing it, @tomscut! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hadoop] tasanuma merged pull request #4210: HDFS-16552. Fix NPE for TestBlockManager

2022-04-22 Thread GitBox
tasanuma merged PR #4210: URL: https://github.com/apache/hadoop/pull/4210 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

[jira] [Work logged] (HADOOP-16515) Update the link to compatibility guide

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16515?focusedWorklogId=761190&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-761190 ] ASF GitHub Bot logged work on HADOOP-16515: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4224: HADOOP-16515. Update the link to compatibility guide

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4224: URL: https://github.com/apache/hadoop/pull/4224#issuecomment-1107166119 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18104) Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18104?focusedWorklogId=761181&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-761181 ] ASF GitHub Bot logged work on HADOOP-18104: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3964: HADOOP-18104: S3A: Add configs to configure minSeekForVectorReads and maxReadSizeForVectorReads

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #3964: URL: https://github.com/apache/hadoop/pull/3964#issuecomment-1107096011 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Work logged] (HADOOP-16202) Enhance openFile() for better read performance against object stores

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=761159&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-761159 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #2584: HADOOP-16202. Enhance openFile() for better read performance against object stores

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-1107056515 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=761130&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-761130 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4092: URL: https://github.com/apache/hadoop/pull/4092#issuecomment-1106917665 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18217) shutdownhookmanager should not be multithreaded (deadlock possible)

2022-04-22 Thread Catherinot Remi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526693#comment-17526693 ] Catherinot Remi commented on HADOOP-18217: -- added wtf.java to show what i have

[jira] [Updated] (HADOOP-18217) shutdownhookmanager should not be multithreaded (deadlock possible)

2022-04-22 Thread Catherinot Remi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catherinot Remi updated HADOOP-18217: - Attachment: wtf.java > shutdownhookmanager should not be multithreaded (deadlock possib

[jira] [Updated] (HADOOP-18217) shutdownhookmanager should not be multithreaded (deadlock possible)

2022-04-22 Thread Catherinot Remi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catherinot Remi updated HADOOP-18217: - Description: the ShutdownHookManager class uses an executor to run hooks to have a "tim

[jira] [Work logged] (HADOOP-16965) Introduce StreamContext for Abfs Input and Output streams.

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16965?focusedWorklogId=761043&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-761043 ] ASF GitHub Bot logged work on HADOOP-16965: --- Author: ASF GitHub B

[GitHub] [hadoop] virajith commented on pull request #4171: HADOOP-16965. Refactor abfs stream configuration. (#1956)

2022-04-22 Thread GitBox
virajith commented on PR #4171: URL: https://github.com/apache/hadoop/pull/4171#issuecomment-1106791802 > @virajith ok, it's almost completely dead. but it still has to compile against java7, uses lots of old dependencies, including the older mockito and logging apis. backporting is a major

[GitHub] [hadoop] huaxiangsun commented on a diff in pull request #4170: HDFS-16540 Data locality is lost when DataNode pod restarts in kubern…

2022-04-22 Thread GitBox
huaxiangsun commented on code in PR #4170: URL: https://github.com/apache/hadoop/pull/4170#discussion_r856498429 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestDatanodeManager.java: ## @@ -138,6 +138,35 @@ public void testNumVe

[GitHub] [hadoop] huaxiangsun commented on a diff in pull request #4170: HDFS-16540 Data locality is lost when DataNode pod restarts in kubern…

2022-04-22 Thread GitBox
huaxiangsun commented on code in PR #4170: URL: https://github.com/apache/hadoop/pull/4170#discussion_r856493693 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java: ## @@ -1189,16 +1190,25 @@ public void registerDa

[GitHub] [hadoop] huaxiangsun commented on a diff in pull request #4170: HDFS-16540 Data locality is lost when DataNode pod restarts in kubern…

2022-04-22 Thread GitBox
huaxiangsun commented on code in PR #4170: URL: https://github.com/apache/hadoop/pull/4170#discussion_r856493317 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/DatanodeManager.java: ## @@ -1189,16 +1190,25 @@ public void registerDa

[GitHub] [hadoop] hadoop-yetus commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1106760921 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4223: MAPREDUCE-7246. In MapredAppMasterRest#Mapreduce_Application_Master_I…

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4223: URL: https://github.com/apache/hadoop/pull/4223#issuecomment-1106751748 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] dineshchitlangia merged pull request #4217: HDFS-16556.Fixtypos in distcp

2022-04-22 Thread GitBox
dineshchitlangia merged PR #4217: URL: https://github.com/apache/hadoop/pull/4217 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr

[jira] [Work logged] (HADOOP-18122) ViewFileSystem fails on determining owning group when primary group doesn't exist for user

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18122?focusedWorklogId=760997&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760997 ] ASF GitHub Bot logged work on HADOOP-18122: --- Author: ASF GitHub B

[GitHub] [hadoop] cheyu2022 commented on a diff in pull request #3987: HADOOP-18122. ViewFileSystem fails on determining owning group when primary group doesn't exist for user

2022-04-22 Thread GitBox
cheyu2022 commented on code in PR #3987: URL: https://github.com/apache/hadoop/pull/3987#discussion_r856457617 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFs.java: ## @@ -1466,5 +1476,27 @@ public void setStoragePolicy(Path path, String

[GitHub] [hadoop] hadoop-yetus commented on pull request #4222: YARN-10187. Removing hadoop-yarn-project/hadoop-yarn/README as it is …

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4222: URL: https://github.com/apache/hadoop/pull/4222#issuecomment-1106736929 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Comment Edited] (HADOOP-16515) Update the link to compatibility guide

2022-04-22 Thread Ashutosh Gupta (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526600#comment-17526600 ] Ashutosh Gupta edited comment on HADOOP-16515 at 4/22/22 5:53 PM: ---

[jira] [Work logged] (HADOOP-16515) Update the link to compatibility guide

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16515?focusedWorklogId=760990&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760990 ] ASF GitHub Bot logged work on HADOOP-16515: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-16515) Update the link to compatibility guide

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-16515: Labels: newbie pull-request-available (was: newbie) > Update the link to compatibility g

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4224: HADOOP-16515. Update the link to compatibility guide

2022-04-22 Thread GitBox
ashutoshcipher opened a new pull request, #4224: URL: https://github.com/apache/hadoop/pull/4224 ### Description of PR HADOOP-16515. Update the link to compatibility guide * HADOOP-16515 -- This is an automated message from the Apache Git Service. To respond to the message, p

[jira] [Work logged] (HADOOP-18122) ViewFileSystem fails on determining owning group when primary group doesn't exist for user

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18122?focusedWorklogId=760989&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760989 ] ASF GitHub Bot logged work on HADOOP-18122: --- Author: ASF GitHub B

[GitHub] [hadoop] cheyu2022 commented on a diff in pull request #3987: HADOOP-18122. ViewFileSystem fails on determining owning group when primary group doesn't exist for user

2022-04-22 Thread GitBox
cheyu2022 commented on code in PR #3987: URL: https://github.com/apache/hadoop/pull/3987#discussion_r856454695 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFs.java: ## @@ -1466,5 +1476,27 @@ public void setStoragePolicy(Path path, String

[jira] [Commented] (HADOOP-16515) Update the link to compatibility guide

2022-04-22 Thread Ashutosh Gupta (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526600#comment-17526600 ] Ashutosh Gupta commented on HADOOP-16515: - [~aajisaka] - Thanks for adding the

[jira] [Assigned] (HADOOP-16515) Update the link to compatibility guide

2022-04-22 Thread Ashutosh Gupta (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Gupta reassigned HADOOP-16515: --- Assignee: Ashutosh Gupta > Update the link to compatibility guide > --

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=760958&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760958 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub B

[GitHub] [hadoop] hchaverri commented on a diff in pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-04-22 Thread GitBox
hchaverri commented on code in PR #4092: URL: https://github.com/apache/hadoop/pull/4092#discussion_r856427800 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/security/token/delegation/TestDelegationToken.java: ## @@ -579,4 +634,85 @@ public void testEmpty

[jira] [Work logged] (HADOOP-18167) Add metrics to track delegation token secret manager operations

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18167?focusedWorklogId=760956&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760956 ] ASF GitHub Bot logged work on HADOOP-18167: --- Author: ASF GitHub B

[GitHub] [hadoop] hchaverri commented on a diff in pull request #4092: HADOOP-18167. Add metrics to track delegation token secret manager op…

2022-04-22 Thread GitBox
hchaverri commented on code in PR #4092: URL: https://github.com/apache/hadoop/pull/4092#discussion_r856425759 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/token/delegation/AbstractDelegationTokenSecretManager.java: ## @@ -825,4 +858,68 @@ prot

[jira] [Resolved] (HADOOP-17564) Fix typo in UnixShellGuide.html

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17564. - Fix Version/s: 3.3.4 Resolution: Fixed > Fix typo in UnixShellGuide.html > -

[jira] [Work logged] (HADOOP-17564) Fix typo in UnixShellGuide.html

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17564?focusedWorklogId=760949&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760949 ] ASF GitHub Bot logged work on HADOOP-17564: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran merged pull request #4195: HADOOP-17564. Fix typo in UnixShellGuide.html

2022-04-22 Thread GitBox
steveloughran merged PR #4195: URL: https://github.com/apache/hadoop/pull/4195 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Work logged] (HADOOP-18177) document use and architecture design of prefetching s3a input stream

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18177?focusedWorklogId=760945&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760945 ] ASF GitHub Bot logged work on HADOOP-18177: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a diff in pull request #4205: HADOOP-18177. Document prefetching architecture.

2022-04-22 Thread GitBox
steveloughran commented on code in PR #4205: URL: https://github.com/apache/hadoop/pull/4205#discussion_r856383998 ## hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/prefetching.md: ## @@ -0,0 +1,151 @@ + + +# S3A Prefetching + + +This document explains the `S3Prefetc

[jira] [Commented] (HADOOP-18217) shutdownhookmanager should not be multithreaded (deadlock possible)

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526555#comment-17526555 ] Steve Loughran commented on HADOOP-18217: - hmm. i'd thought that code would fa

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4223: MAPREDUCE-7246. In MapredAppMasterRest#Mapreduce_Application_Master_I…

2022-04-22 Thread GitBox
ashutoshcipher opened a new pull request, #4223: URL: https://github.com/apache/hadoop/pull/4223 ### Description of PR In MapredAppMasterRest#Mapreduce_Application_Master_Info_API, updating the datatype of appId to "string". * JIRA: MAPREDUCE-7246 -- This is an automated message

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526550#comment-17526550 ] Akira Ajisaka commented on HADOOP-18198: Built artifacts and uploaded to [http

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4222: YARN-10187. Removing hadoop-yarn-project/hadoop-yarn/README as it is …

2022-04-22 Thread GitBox
ashutoshcipher opened a new pull request, #4222: URL: https://github.com/apache/hadoop/pull/4222 ### Description of PR Removing hadoop-yarn-project/hadoop-yarn/README as it is no longer maintained. * JIRA: YARN-10187 -- This is an automated message from the Apache Git Service. T

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526544#comment-17526544 ] Steve Loughran commented on HADOOP-18198: - bq. Are you able to download all the

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526542#comment-17526542 ] Steve Loughran commented on HADOOP-18198: - my real, real, gpg key lives on a fi

[jira] [Created] (HADOOP-18217) shutdownhookmanager should not be multithreaded (deadlock possible)

2022-04-22 Thread Catherinot Remi (Jira)
Catherinot Remi created HADOOP-18217: Summary: shutdownhookmanager should not be multithreaded (deadlock possible) Key: HADOOP-18217 URL: https://issues.apache.org/jira/browse/HADOOP-18217 Project

[GitHub] [hadoop] hadoop-yetus commented on pull request #4219: HDFS-16557. BootstrapStandby failed because of checking gap for inprogress EditLogInputStream

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4219: URL: https://github.com/apache/hadoop/pull/4219#issuecomment-1106630776 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Work logged] (HADOOP-18216) Ensure "io.file.buffer.size" is greater than zero. Otherwise, it will lead to data read/write blockage

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18216?focusedWorklogId=760870&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760870 ] ASF GitHub Bot logged work on HADOOP-18216: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #4220: HADOOP-18216. io.file.buffer.size must be greater than zero

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4220: URL: https://github.com/apache/hadoop/pull/4220#issuecomment-1106613650 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1106572107 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4221: YARN-10303. Fixing rest api example in ResourceManagerRest.md

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4221: URL: https://github.com/apache/hadoop/pull/4221#issuecomment-1106564905 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4210: HDFS-16552. Fix NPE for TestBlockManager

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4210: URL: https://github.com/apache/hadoop/pull/4210#issuecomment-1106497235 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #4213: HDFS-16554 Remove unused configuration dfs.namenode.block.deletion.increment.

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4213: URL: https://github.com/apache/hadoop/pull/4213#issuecomment-1106492118 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4221: YARN-10303. Fixing rest api example in ResourceManagerRest.md

2022-04-22 Thread GitBox
ashutoshcipher opened a new pull request, #4221: URL: https://github.com/apache/hadoop/pull/4221 ### Description of PR Fixing rest api example in ResourceManagerRest.md * JIRA: YARN-10303 -- This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hadoop] cndaimin commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
cndaimin commented on PR #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1106462870 @tomscut hdfs-default.xml updated. Thanks for your reminding! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] hadoop-yetus commented on pull request #4207: HDFS-16545. Provide an option to balance rack level in Balancers

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4207: URL: https://github.com/apache/hadoop/pull/4207#issuecomment-1106435853 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] prasad-acit commented on pull request #4207: HDFS-16545. Provide an option to balance rack level in Balancers

2022-04-22 Thread GitBox
prasad-acit commented on PR #4207: URL: https://github.com/apache/hadoop/pull/4207#issuecomment-1106418525 Failed UT is not related. Checkstyle 1 not related & 2 related to param count which already exceeded. @hemanthboyina @surendralilhore Can you please review the PR? -- This i

[jira] [Work logged] (HADOOP-18079) Upgrade Netty to 4.1.74

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?focusedWorklogId=760740&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760740 ] ASF GitHub Bot logged work on HADOOP-18079: --- Author: ASF GitHub B

[GitHub] [hadoop] prasad-acit commented on pull request #3977: HADOOP-18079. Upgrade Netty to 4.1.74.

2022-04-22 Thread GitBox
prasad-acit commented on PR #3977: URL: https://github.com/apache/hadoop/pull/3977#issuecomment-1106412738 @jojochuang this PR can be merged? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[jira] [Updated] (HADOOP-18216) Ensure "io.file.buffer.size" is greater than zero. Otherwise, it will lead to data read/write blockage

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18216: Labels: pull-request-available (was: ) > Ensure "io.file.buffer.size" is greater than ze

[jira] [Work logged] (HADOOP-18216) Ensure "io.file.buffer.size" is greater than zero. Otherwise, it will lead to data read/write blockage

2022-04-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18216?focusedWorklogId=760739&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760739 ] ASF GitHub Bot logged work on HADOOP-18216: --- Author: ASF GitHub B

[GitHub] [hadoop] liever18 opened a new pull request, #4220: HADOOP-18216. io.file.buffer.size must be greater than zero

2022-04-22 Thread GitBox
liever18 opened a new pull request, #4220: URL: https://github.com/apache/hadoop/pull/4220 ### Description of PR [HADOOP-18216](https://issues.apache.org/jira/browse/HADOOP-18216) Modify the description of "io.file.buffer.size" in the default configuration file to prevent io operations

[jira] [Created] (HADOOP-18216) Ensure "io.file.buffer.size" is greater than zero. Otherwise, it will lead to data read/write blockage

2022-04-22 Thread Jingxuan Fu (Jira)
Jingxuan Fu created HADOOP-18216: Summary: Ensure "io.file.buffer.size" is greater than zero. Otherwise, it will lead to data read/write blockage Key: HADOOP-18216 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526315#comment-17526315 ] Ayush Saxena commented on HADOOP-18198: --- mostly a network issue. [~ste...@apache.

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526311#comment-17526311 ] Steve Loughran commented on HADOOP-18198: - also been reminded of HDFS-16453 tha

[GitHub] [hadoop] hadoop-yetus commented on pull request #4211: HDFS-16553 Fix checkstyle for the length of BlockManager construction method over limit.

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4211: URL: https://github.com/apache/hadoop/pull/4211#issuecomment-1106320862 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Resolved] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18069. - Resolution: Duplicate > CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client > -

[jira] [Commented] (HADOOP-18069) CVE-2021-0341 in okhttp@2.7.5 detected in hdfs-client

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526304#comment-17526304 ] Steve Loughran commented on HADOOP-18069: - not seen any response; i do see ther

[jira] [Commented] (HADOOP-16613) s3a to set fake directory marker contentType to application/x-directory

2022-04-22 Thread Brais Couce (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526303#comment-17526303 ] Brais Couce commented on HADOOP-16613: -- You are right. It works fine with 3.3.2. T

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-22 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526301#comment-17526301 ] Akira Ajisaka commented on HADOOP-18198: {quote}i've been setting up to do it f

[GitHub] [hadoop] steveloughran commented on pull request #4216: HDFS-16555. rename mixlead method name in DistCpOptions

2022-04-22 Thread GitBox
steveloughran commented on PR #4216: URL: https://github.com/apache/hadoop/pull/4216#issuecomment-1106271801 api is tagged as @InterfaceAudience.Public;; we can't remove the existing method. you could add a new one with the better name and mark the old one as deprecated -- This is an aut

[jira] [Commented] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-04-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526297#comment-17526297 ] Steve Loughran commented on HADOOP-18198: - i can't build locally (at least wher

[GitHub] [hadoop] tomscut opened a new pull request, #4219: HDFS-16557. BootstrapStandby failed because of checking Gap for inprogress EditLogInputStream

2022-04-22 Thread GitBox
tomscut opened a new pull request, #4219: URL: https://github.com/apache/hadoop/pull/4219 JIRA: HDFS-16557. The lastTxId of an inprogress EditLogInputStream lastTxId isn't necessarily HdfsServerConstants.INVALID_TXID. We can determine its status directly by EditLogInputStream#isInPro

[GitHub] [hadoop] tomscut commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
tomscut commented on PR #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1106186456 Thanks @tasanuma and @cndaimin for your explanation. This makes sense to me. @cndaimin Could you please add this configurations to hdfs-default.xml? Thanks. -- This is an automa

[GitHub] [hadoop] cndaimin commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
cndaimin commented on PR #4101: URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1106154139 @tasanuma Thanks for your review and comments! Yes, we have used the feature in our production cluster for nearly 1 year and it looks good. - `dfs.datanode.data.write.bandwidthPerSe

[GitHub] [hadoop] hadoop-yetus commented on pull request #4207: HDFS-16545. Provide an option to balance rack level in Balancers

2022-04-22 Thread GitBox
hadoop-yetus commented on PR #4207: URL: https://github.com/apache/hadoop/pull/4207#issuecomment-1106125775 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] cndaimin commented on a diff in pull request #4101: HDFS-16519. Add throttler to EC reconstruction

2022-04-22 Thread GitBox
cndaimin commented on code in PR #4101: URL: https://github.com/apache/hadoop/pull/4101#discussion_r855857036 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java: ## @@ -119,6 +119,14 @@ public class DFSConfigKeys extends CommonConfiguratio

[GitHub] [hadoop] cndaimin commented on pull request #4104: HDFS-16520. Improve EC pread: avoid potential reading whole block

2022-04-22 Thread GitBox
cndaimin commented on PR #4104: URL: https://github.com/apache/hadoop/pull/4104#issuecomment-1106106812 @tasanuma Thanks for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [hadoop] aajisaka commented on pull request #4177: HDFS-16542. Fix failed unit tests in branch branch-3.2

2022-04-22 Thread GitBox
aajisaka commented on PR #4177: URL: https://github.com/apache/hadoop/pull/4177#issuecomment-1106077830 > Please help backporting [HDFS-13983](https://issues.apache.org/jira/browse/HDFS-13983). Thanks. Done. Thanks! -- This is an automated message from the Apache Git Service. To re