[GitHub] [hadoop] hadoop-yetus commented on pull request #3667: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3667: URL: https://github.com/apache/hadoop/pull/3667#issuecomment-971323286 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=682408=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682408 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] symious commented on a change in pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-16 Thread GitBox
symious commented on a change in pull request #3658: URL: https://github.com/apache/hadoop/pull/3658#discussion_r750944899 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Client.java ## @@ -1679,11 +1679,13 @@ private Connection

[jira] [Resolved] (HADOOP-17999) No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem

2021-11-16 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HADOOP-17999. -- Fix Version/s: 3.4.0 2.10.2 3.2.4

[GitHub] [hadoop] tasanuma opened a new pull request #3668: Backport HDFS-15963 to branch-3.2

2021-11-16 Thread GitBox
tasanuma opened a new pull request #3668: URL: https://github.com/apache/hadoop/pull/3668 ### Description of PR Backport HDFS-15963 to branch-3.2. Cherry-picked it from branch-3.3 with fixing a minor conflict. ### How was this patch tested? ### For code changes:

[GitHub] [hadoop] tomscut commented on pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-16 Thread GitBox
tomscut commented on pull request #3666: URL: https://github.com/apache/hadoop/pull/3666#issuecomment-971192664 > Cherry-picked it to branch-3.2 with fixing a minor conflict. Thanks for your help. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] tasanuma commented on pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-16 Thread GitBox
tasanuma commented on pull request #3666: URL: https://github.com/apache/hadoop/pull/3666#issuecomment-971181425 Cherry-picked it to branch-3.2 with fixing a minor conflict. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] tomscut commented on pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-16 Thread GitBox
tomscut commented on pull request #3666: URL: https://github.com/apache/hadoop/pull/3666#issuecomment-971098210 > Thanks for your contribution, @tomscut. Thanks for the merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] tasanuma commented on pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-16 Thread GitBox
tasanuma commented on pull request #3666: URL: https://github.com/apache/hadoop/pull/3666#issuecomment-971096043 Thanks for your contribution, @tomscut. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop] tasanuma merged pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-16 Thread GitBox
tasanuma merged pull request #3666: URL: https://github.com/apache/hadoop/pull/3666 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-17999) No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem

2021-11-16 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-17999: - Summary: No-op implementation of setWriteChecksum and setVerifyChecksum in

[jira] [Commented] (HADOOP-17998) Enable get command run with multi-thread

2021-11-16 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444894#comment-17444894 ] Chengwei Wang commented on HADOOP-17998: Hi  [~sodonnell] , [~hexiaoqiao] , [~weichiu], can you

[GitHub] [hadoop] tomscut commented on pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-16 Thread GitBox
tomscut commented on pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#issuecomment-971026573 Hi @tasanuma @jojochuang @ferhui @ayushtkn , could you please take a look at this. Thank you very much. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] tomscut commented on pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-16 Thread GitBox
tomscut commented on pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#issuecomment-971023970 > There's a failure with TestRouterDistCpProcedure but I don't see how it can be related. Can you confirm? Thank @goiri for your review. This failed unit test is unrelated

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=682356=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682356 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=682357=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682357 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[GitHub] [hadoop] shvachko edited a comment on pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-16 Thread GitBox
shvachko edited a comment on pull request #3639: URL: https://github.com/apache/hadoop/pull/3639#issuecomment-970989434 +1 for the last patch. Looks like yetus also approves. Will commit this shortly. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] shvachko commented on pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-16 Thread GitBox
shvachko commented on pull request #3639: URL: https://github.com/apache/hadoop/pull/3639#issuecomment-970989434 +1 for the past patch. Looks like yetus also approves. Will commit this shortly. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=682352=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682352 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3639: URL: https://github.com/apache/hadoop/pull/3639#issuecomment-970961473 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17946) Update commons-lang to latest 3.x

2021-11-16 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17946: -- Fix Version/s: 3.3.2 > Update commons-lang to latest 3.x > - > >

[jira] [Updated] (HADOOP-16963) HADOOP-16582 changed mkdirs() behavior

2021-11-16 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-16963: -- Target Version/s: 3.4.0, 3.3.3 (was: 3.4.0, 3.3.2) > HADOOP-16582 changed mkdirs() behavior >

[jira] [Updated] (HADOOP-17006) Fix the CosCrendentials Provider in core-site.xml for unit tests.

2021-11-16 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HADOOP-17006: -- Target Version/s: 3.3.3 (was: 3.3.2) > Fix the CosCrendentials Provider in core-site.xml for unit

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=682323=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682323 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=682322=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682322 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] abhishekdas99 commented on a change in pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-16 Thread GitBox
abhishekdas99 commented on a change in pull request #3639: URL: https://github.com/apache/hadoop/pull/3639#discussion_r750770445 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -917,13 +917,9 @@ public void

[GitHub] [hadoop] fapifta commented on a change in pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-16 Thread GitBox
fapifta commented on a change in pull request #3658: URL: https://github.com/apache/hadoop/pull/3658#discussion_r750770358 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Client.java ## @@ -1679,11 +1679,13 @@ private Connection

[GitHub] [hadoop] KevinWikant opened a new pull request #3667: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-16 Thread GitBox
KevinWikant opened a new pull request #3667: URL: https://github.com/apache/hadoop/pull/3667 ### Description of PR Fixes a bug in Hadoop HDFS where if more than "dfs.namenode.decommission.max.concurrent.tracked.nodes" datanodes are lost while in state decommissioning, then all

[GitHub] [hadoop] hadoop-yetus commented on pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#issuecomment-970682650 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-16 Thread Abhishek Das (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444793#comment-17444793 ] Abhishek Das commented on HADOOP-17999: --- The initial implementation in the patch was to keep

[GitHub] [hadoop] goiri commented on pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-16 Thread GitBox
goiri commented on pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#issuecomment-970623166 There's a failure with TestRouterDistCpProcedure but I don't see how it can be related. Can you confirm? -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-site] aajisaka commented on pull request #30: Update prabhujoseph's organization

2021-11-16 Thread GitBox
aajisaka commented on pull request #30: URL: https://github.com/apache/hadoop-site/pull/30#issuecomment-970464969 Would you update `hugo` to the latest version and generate the document again? I think it will remove the extra lines generated. -- This is an automated message from the

[GitHub] [hadoop-site] GauthamBanasandra edited a comment on pull request #30: Update prabhujoseph's organization

2021-11-16 Thread GitBox
GauthamBanasandra edited a comment on pull request #30: URL: https://github.com/apache/hadoop-site/pull/30#issuecomment-970463356 @PrabhuJoseph could you please confirm that your org is correct? Please see `src/who.md` in this commit

[GitHub] [hadoop-site] GauthamBanasandra commented on pull request #30: Update prabhujoseph's organization

2021-11-16 Thread GitBox
GauthamBanasandra commented on pull request #30: URL: https://github.com/apache/hadoop-site/pull/30#issuecomment-970463356 @PrabhuJoseph could you please confirm that your org is correct? Please see src/who.md in this commit

[GitHub] [hadoop] minni31 commented on pull request #3607: YARN-8859. Add audit logs for router service

2021-11-16 Thread GitBox
minni31 commented on pull request #3607: URL: https://github.com/apache/hadoop/pull/3607#issuecomment-970412387 @goiri, Thanks for the review. I've addressed the comment. Can you please help with review further ? -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] minni31 edited a comment on pull request #3607: YARN-8859. Add audit logs for router service

2021-11-16 Thread GitBox
minni31 edited a comment on pull request #3607: URL: https://github.com/apache/hadoop/pull/3607#issuecomment-970412387 @goiri, Thanks for the review. I've addressed the comments. Can you please help with review further ? -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] tomscut commented on a change in pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-16 Thread GitBox
tomscut commented on a change in pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#discussion_r750410323 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -228,6 +228,26 @@ public Builder

[GitHub] [hadoop] hadoop-yetus commented on pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#issuecomment-970396882 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] afchung commented on pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-16 Thread GitBox
afchung commented on pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#issuecomment-970389378 @bibinchundatt thanks for the review! Updated the PR to address your comments. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] afchung commented on a change in pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-16 Thread GitBox
afchung commented on a change in pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#discussion_r750355189 ## File path:

[GitHub] [hadoop] ayushtkn closed pull request #3665: pull-request-creator 1

2021-11-16 Thread GitBox
ayushtkn closed pull request #3665: URL: https://github.com/apache/hadoop/pull/3665 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] ayushtkn commented on pull request #3665: pull-request-creator 1

2021-11-16 Thread GitBox
ayushtkn commented on pull request #3665: URL: https://github.com/apache/hadoop/pull/3665#issuecomment-970316348 Invalid PR, please refrain from doing such stuff, it wastes apache infra resources. :-( -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=682004=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-682004 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] symious commented on a change in pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-16 Thread GitBox
symious commented on a change in pull request #3658: URL: https://github.com/apache/hadoop/pull/3658#discussion_r750273710 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Client.java ## @@ -1679,11 +1679,13 @@ private Connection

[GitHub] [hadoop] hadoop-yetus commented on pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3666: URL: https://github.com/apache/hadoop/pull/3666#issuecomment-970234592 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3470: YARN-10965. Centralize queue resource calculation based on CapacityVectors

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3470: URL: https://github.com/apache/hadoop/pull/3470#issuecomment-970193460 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3664: URL: https://github.com/apache/hadoop/pull/3664#issuecomment-970191157 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3664: URL: https://github.com/apache/hadoop/pull/3664#issuecomment-970182497 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3651: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3651: URL: https://github.com/apache/hadoop/pull/3651#issuecomment-970182080 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1783#comment-1783 ] Steve Loughran commented on HADOOP-17979: - applications wanting to use this to recover from

[jira] [Resolved] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur resolved HADOOP-18002. Resolution: Fixed > abfs rename idempotency broken -remove recovery >

[jira] [Updated] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-16 Thread Mukund Thakur (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukund Thakur updated HADOOP-18002: --- Fix Version/s: 3.4.0 > abfs rename idempotency broken -remove recovery >

[jira] [Work logged] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?focusedWorklogId=681944=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681944 ] ASF GitHub Bot logged work on HADOOP-18002: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur merged pull request #3641: HADOOP-18002. abfs rename idempotency broken -remove recovery

2021-11-16 Thread GitBox
mukund-thakur merged pull request #3641: URL: https://github.com/apache/hadoop/pull/3641 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] mariosmeim-db commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-16 Thread GitBox
mariosmeim-db commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r750163276 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java ## @@ -906,6 +907,36 @@ public

[GitHub] [hadoop] mariosmeim-db commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-16 Thread GitBox
mariosmeim-db commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r750163276 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java ## @@ -906,6 +907,36 @@ public

[GitHub] [hadoop] mariosmeim-db commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-16 Thread GitBox
mariosmeim-db commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r750162817 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java ## @@ -906,6 +907,36 @@ public

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=681937=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681937 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-16 Thread GitBox
steveloughran commented on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-970156429 yetus is done. it's complaining about deprecation, but the deprecated method is only used in the s3a code in s3guard classes cut in another PR. I'm not going to fix them

[jira] [Work logged] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?focusedWorklogId=681931=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681931 ] ASF GitHub Bot logged work on HADOOP-18002: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3641: HADOOP-18002. abfs rename idempotency broken -remove recovery

2021-11-16 Thread GitBox
steveloughran commented on pull request #3641: URL: https://github.com/apache/hadoop/pull/3641#issuecomment-970154291 *this patch is complete*. I have nothing further to do in it, all it needs is review. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] GuoPhilipse commented on pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-16 Thread GitBox
GuoPhilipse commented on pull request #3661: URL: https://github.com/apache/hadoop/pull/3661#issuecomment-970145881 @tomscut the tests rerun ok  :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] jojochuang merged pull request #3320: HDFS-16182.numOfReplicas is given the wrong value in BlockPlacementPolicyDefault$chooseTarget can cause DataStreamer to fail with Heterogeneous

2021-11-16 Thread GitBox
jojochuang merged pull request #3320: URL: https://github.com/apache/hadoop/pull/3320 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3660: YARN-10982

2021-11-16 Thread GitBox
9uapaw commented on a change in pull request #3660: URL: https://github.com/apache/hadoop/pull/3660#discussion_r750050820 ## File path:

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2021-11-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=681910=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681910 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2021-11-16 Thread GitBox
steveloughran commented on pull request #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-970122181 ``` Data has 42 rows clustered true for 2000 Generating table call_center in database to

[GitHub] [hadoop] symious commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-16 Thread GitBox
symious commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-970095793 @ferhui Thank you for the review. Updated a document to better illustrate the idea.

[GitHub] [hadoop] bibinchundatt commented on a change in pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-16 Thread GitBox
bibinchundatt commented on a change in pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#discussion_r750070889 ## File path:

[GitHub] [hadoop] bibinchundatt commented on a change in pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-16 Thread GitBox
bibinchundatt commented on a change in pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#discussion_r750058852 ## File path:

[GitHub] [hadoop] bibinchundatt commented on a change in pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-16 Thread GitBox
bibinchundatt commented on a change in pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#discussion_r750058852 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3661: URL: https://github.com/apache/hadoop/pull/3661#issuecomment-97206 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3663: HDFS-16326. Simplify the code for DiskBalancer

2021-11-16 Thread GitBox
hadoop-yetus commented on pull request #3663: URL: https://github.com/apache/hadoop/pull/3663#issuecomment-969984051 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0