[GitHub] [hadoop] slfan1989 opened a new pull request, #4276: YARN-11130:removed unused import

2022-05-06 Thread GitBox
slfan1989 opened a new pull request, #4276: URL: https://github.com/apache/hadoop/pull/4276 RouterClientRMService Has Unused import, keep the code clean and remove unused. https://issues.apache.org/jira/browse/YARN-11130 -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] slfan1989 closed pull request #4275: YARN-11130:Rmove RouterClientRMService Has Unused import

2022-05-06 Thread GitBox
slfan1989 closed pull request #4275: YARN-11130:Rmove RouterClientRMService Has Unused import URL: https://github.com/apache/hadoop/pull/4275 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #4274: Yarn-11122:Support getClusterNodes In Federation architecture

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4274: URL: https://github.com/apache/hadoop/pull/4274#issuecomment-1120133533 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] zhengchenyu commented on pull request #4270: YARN-11127. Potential deadlock in AsyncDispatcher caused by RMNodeImp…

2022-05-06 Thread GitBox
zhengchenyu commented on PR #4270: URL: https://github.com/apache/hadoop/pull/4270#issuecomment-1120125595 To make sure unittest pass, I submit https://github.com/apache/hadoop/pull/4270/commits/f887c7a810e2f9187d013bb8cb4ead79a44ab2c6. But I think this unittest fail, was not

[GitHub] [hadoop] slfan1989 opened a new pull request, #4275: YARN-11130:org.apache.hadoop.yarn.server.router.clientrm#RouterClientRMService Has Unused import

2022-05-06 Thread GitBox
slfan1989 opened a new pull request, #4275: URL: https://github.com/apache/hadoop/pull/4275 ### Description of PR [YARN-11130:org.apache.hadoop.yarn.server.router.clientrm#RouterClientRMService Has Unused import](https://issues.apache.org/jira/browse/YARN-11130) During code

[GitHub] [hadoop] hadoop-yetus commented on pull request #4269: HDFS-16570 RBF: The router using MultipleDestinationMountTableResolve…

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4269: URL: https://github.com/apache/hadoop/pull/4269#issuecomment-1120121285 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 opened a new pull request, #4274: Yarn-11122:Support getClusterNodes In Federation architecture

2022-05-06 Thread GitBox
slfan1989 opened a new pull request, #4274: URL: https://github.com/apache/hadoop/pull/4274 ### Description of PR In [YARN-10465](https://issues.apache.org/jira/browse/YARN-10465), some methods have been implemented, from a personal point of view, some doubts. Question 1: Without

[GitHub] [hadoop] tomscut commented on pull request #4264: HDFS-16568. dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-06 Thread GitBox
tomscut commented on PR #4264: URL: https://github.com/apache/hadoop/pull/4264#issuecomment-1120115493 Hi @virajjasani , please take a look at the failed unit test. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-18222) Prevent DelegationTokenSecretManagerMetrics from registering multiple times

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18222?focusedWorklogId=767495=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767495 ] ASF GitHub Bot logged work on HADOOP-18222: --- Author: ASF GitHub Bot

[GitHub] [hadoop] slfan1989 commented on pull request #4266: HADOOP-18222. Prevent DelegationTokenSecretManagerMetrics from registering multiple times

2022-05-06 Thread GitBox
slfan1989 commented on PR #4266: URL: https://github.com/apache/hadoop/pull/4266#issuecomment-1120114498 Hi,@hchaverri,@omalley I'm very sorry, but I don't know if you can roll back the changes of HADOOP-18167 first. This change has caused many Junit Tests related to RM to fail. I tried to

[GitHub] [hadoop] hadoop-yetus commented on pull request #4264: HDFS-16568. dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4264: URL: https://github.com/apache/hadoop/pull/4264#issuecomment-1120105922 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18107) Vectored IO support for large S3 files.

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18107?focusedWorklogId=767464=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767464 ] ASF GitHub Bot logged work on HADOOP-18107: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4273: HADOOP-18107 Adding scale test for vectored reads for large file

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4273: URL: https://github.com/apache/hadoop/pull/4273#issuecomment-1120079516 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 closed pull request #4250: YARN-11121:Check GetClusterMetrics Request parameter is null

2022-05-06 Thread GitBox
slfan1989 closed pull request #4250: YARN-11121:Check GetClusterMetrics Request parameter is null URL: https://github.com/apache/hadoop/pull/4250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (HADOOP-18079) Upgrade Netty to 4.1.76

2022-05-06 Thread Tamas Penzes (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tamas Penzes updated HADOOP-18079: -- Description: h4. Netty version - 4.1.71 has fix some CVEs. We can upgrade  the netty to

[jira] [Updated] (HADOOP-18079) Upgrade Netty to 4.1.76

2022-05-06 Thread Tamas Penzes (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tamas Penzes updated HADOOP-18079: -- Summary: Upgrade Netty to 4.1.76 (was: Upgrade Netty to 4.1.74) > Upgrade Netty to 4.1.76 >

[GitHub] [hadoop] tamaashu closed pull request #3810: HDFS-16384. Upgrade Netty to 4.1.72.Final

2022-05-06 Thread GitBox
tamaashu closed pull request #3810: HDFS-16384. Upgrade Netty to 4.1.72.Final URL: https://github.com/apache/hadoop/pull/3810 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] saintstack commented on pull request #4246: HDFS-16540. Data locality is lost when DataNode pod restarts in kubernetes (#4170)

2022-05-06 Thread GitBox
saintstack commented on PR #4246: URL: https://github.com/apache/hadoop/pull/4246#issuecomment-1120006228 Looking at these test failures: * on a full run -- three of the test runs -- I see ~100-120 failures. * looking at the hdfs server, hdfs router, and mapreduce, failures, the

[jira] [Work logged] (HADOOP-18228) Update hadoop-vote to use HADOOP_RC_VERSION dir

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18228?focusedWorklogId=767402=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767402 ] ASF GitHub Bot logged work on HADOOP-18228: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4272: HADOOP-18228. Update hadoop-vote to use HADOOP_RC_VERSION dir

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4272: URL: https://github.com/apache/hadoop/pull/4272#issuecomment-1119984449 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12020?focusedWorklogId=767399=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767399 ] ASF GitHub Bot logged work on HADOOP-12020: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12020?focusedWorklogId=767398=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767398 ] ASF GitHub Bot logged work on HADOOP-12020: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on a diff in pull request #3877: HADOOP-12020. Add configurable storage class option

2022-05-06 Thread GitBox
mukund-thakur commented on code in PR #3877: URL: https://github.com/apache/hadoop/pull/3877#discussion_r867174852 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java: ## @@ -429,6 +429,24 @@ private Constants() { */ public static final

[GitHub] [hadoop] mukund-thakur commented on pull request #3877: HADOOP-12020. Add configurable storage class option

2022-05-06 Thread GitBox
mukund-thakur commented on PR #3877: URL: https://github.com/apache/hadoop/pull/3877#issuecomment-1119969836 > Hi @mukund-thakur, would you be able to take a look? Thanks. Really sorry for missing this. I was travelling and then this mail went down. Looks good from my side

[jira] [Work logged] (HADOOP-18224) Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18224?focusedWorklogId=767396=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767396 ] ASF GitHub Bot logged work on HADOOP-18224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani commented on pull request #4267: HADOOP-18224. Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread GitBox
virajjasani commented on PR #4267: URL: https://github.com/apache/hadoop/pull/4267#issuecomment-1119966961 @aajisaka It seems that newer versions of maven compiler and javadoc plugins are flagging issues with Javadoc. Shall we fix them later? Do you have any recommendations here? --

[jira] [Work logged] (HADOOP-18107) Vectored IO support for large S3 files.

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18107?focusedWorklogId=767392=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767392 ] ASF GitHub Bot logged work on HADOOP-18107: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-18107) Vectored IO support for large S3 files.

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18107: Labels: pull-request-available (was: ) > Vectored IO support for large S3 files. >

[GitHub] [hadoop] mukund-thakur opened a new pull request, #4273: HADOOP-18107 Adding scale test for vectored reads for large file

2022-05-06 Thread GitBox
mukund-thakur opened a new pull request, #4273: URL: https://github.com/apache/hadoop/pull/4273 part of HADOOP-18103. ### Description of PR ### How was this patch tested? Reran the changed tests. ### For code changes: - [ ] Does the title or this PR starts

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=767373=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767373 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-1119937507 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18228) Update hadoop-vote to use HADOOP_RC_VERSION dir

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18228: Labels: pull-request-available (was: ) > Update hadoop-vote to use HADOOP_RC_VERSION

[jira] [Work logged] (HADOOP-18228) Update hadoop-vote to use HADOOP_RC_VERSION dir

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18228?focusedWorklogId=767367=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767367 ] ASF GitHub Bot logged work on HADOOP-18228: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani opened a new pull request, #4272: HADOOP-18228. Update hadoop-vote to use HADOOP_RC_VERSION dir

2022-05-06 Thread GitBox
virajjasani opened a new pull request, #4272: URL: https://github.com/apache/hadoop/pull/4272 ### Description of PR The recent changes in release script requires a minor change in hadoop-vote to use Hadoop RC version dir before verifying signature and checksum of .tar.gz files.

[jira] [Created] (HADOOP-18228) Update hadoop-vote to use HADOOP_RC_VERSION dir

2022-05-06 Thread Viraj Jasani (Jira)
Viraj Jasani created HADOOP-18228: - Summary: Update hadoop-vote to use HADOOP_RC_VERSION dir Key: HADOOP-18228 URL: https://issues.apache.org/jira/browse/HADOOP-18228 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #4271: Yarn 11128. Fix comments in TestProportionalCapacityPreemptionPolicy*

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4271: URL: https://github.com/apache/hadoop/pull/4271#issuecomment-1119900049 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Created] (HADOOP-18227) Add IOstats for vectored IO api.

2022-05-06 Thread Mukund Thakur (Jira)
Mukund Thakur created HADOOP-18227: -- Summary: Add IOstats for vectored IO api. Key: HADOOP-18227 URL: https://issues.apache.org/jira/browse/HADOOP-18227 Project: Hadoop Common Issue Type:

[jira] [Work logged] (HADOOP-18224) Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18224?focusedWorklogId=767346=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767346 ] ASF GitHub Bot logged work on HADOOP-18224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4267: HADOOP-18224. Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4267: URL: https://github.com/apache/hadoop/pull/4267#issuecomment-1119857150 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18224) Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18224?focusedWorklogId=767345=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767345 ] ASF GitHub Bot logged work on HADOOP-18224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4267: HADOOP-18224. Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4267: URL: https://github.com/apache/hadoop/pull/4267#issuecomment-1119856406 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18224) Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18224?focusedWorklogId=767342=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767342 ] ASF GitHub Bot logged work on HADOOP-18224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4267: HADOOP-18224. Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4267: URL: https://github.com/apache/hadoop/pull/4267#issuecomment-1119854191 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-18224) Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18224?focusedWorklogId=767339=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767339 ] ASF GitHub Bot logged work on HADOOP-18224: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #4267: HADOOP-18224. Upgrade maven compiler plugin to 3.10.1

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4267: URL: https://github.com/apache/hadoop/pull/4267#issuecomment-1119851997 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Moved] (HADOOP-18226) ABFS: Two BlobCreated get triggered for writing one ABFS file

2022-05-06 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena moved HDFS-16571 to HADOOP-18226: -- Component/s: fs/azure (was:

[GitHub] [hadoop] jojochuang merged pull request #4104: HDFS-16520. Improve EC pread: avoid potential reading whole block

2022-05-06 Thread GitBox
jojochuang merged PR #4104: URL: https://github.com/apache/hadoop/pull/4104 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4270: YARN-11127. Potential deadlock in AsyncDispatcher caused by RMNodeImp…

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4270: URL: https://github.com/apache/hadoop/pull/4270#issuecomment-1119826717 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=767297=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767297 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-1119787858 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4268: [Test] Release 3.3.3 RC testing

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4268: URL: https://github.com/apache/hadoop/pull/4268#issuecomment-1119781998 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4268: [Test] Release 3.3.3 RC testing

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4268: URL: https://github.com/apache/hadoop/pull/4268#issuecomment-1119734562 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4268: [Test] Release 3.3.3 RC testing

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4268: URL: https://github.com/apache/hadoop/pull/4268#issuecomment-1119709408 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ashutoshcipher opened a new pull request, #4271: Yarn 11128. Fix comments in TestProportionalCapacityPreemptionPolicy*

2022-05-06 Thread GitBox
ashutoshcipher opened a new pull request, #4271: URL: https://github.com/apache/hadoop/pull/4271 ### Description of PR Fix comments in TestProportionalCapacityPreemptionPolicy* * JIRA: Yarn 11128 - [x] Does the title or this PR starts with the corresponding JIRA issue id

[GitHub] [hadoop] hadoop-yetus commented on pull request #4268: [Test] Release 3.3.3 RC testing

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4268: URL: https://github.com/apache/hadoop/pull/4268#issuecomment-1119698574 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 closed pull request #4249: YARN-11120-Metrics for Federation getClusterMetrics

2022-05-06 Thread GitBox
slfan1989 closed pull request #4249: YARN-11120-Metrics for Federation getClusterMetrics URL: https://github.com/apache/hadoop/pull/4249 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] hadoop-yetus commented on pull request #4268: [Test] Release 3.3.3 RC testing

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4268: URL: https://github.com/apache/hadoop/pull/4268#issuecomment-1119652871 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4269: HDFS-16570 RBF: The router using MultipleDestinationMountTableResolve…

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4269: URL: https://github.com/apache/hadoop/pull/4269#issuecomment-1119577223 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4247: MAPREDUCE-7369. Fixed MapReduce tasks timing out when spends more time on MultipleOutputs#close

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4247: URL: https://github.com/apache/hadoop/pull/4247#issuecomment-1119576832 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-17833) Improve Magic Committer Performance

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?focusedWorklogId=767155=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767155 ] ASF GitHub Bot logged work on HADOOP-17833: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3289: HADOOP-17833. Improve Magic Committer performance

2022-05-06 Thread GitBox
steveloughran commented on PR #3289: URL: https://github.com/apache/hadoop/pull/3289#issuecomment-1119543301 This is ready for review as I've 1. stripped out the overheads from the mkdirs calls too. 2. added a createFile option "fs.s3a.create.performance" to offer the file

[GitHub] [hadoop] zhengchenyu opened a new pull request, #4270: YARN-11127. Potential deadlock in AsyncDispatcher caused by RMNodeImp…

2022-05-06 Thread GitBox
zhengchenyu opened a new pull request, #4270: URL: https://github.com/apache/hadoop/pull/4270 ### Description of PR detail message see:https://issues.apache.org/jira/browse/YARN-11127 ### How was this patch tested? uni-test in PR ### For code changes:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4264: HDFS-16568. dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4264: URL: https://github.com/apache/hadoop/pull/4264#issuecomment-1119519958 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #4264: HDFS-16568. dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4264: URL: https://github.com/apache/hadoop/pull/4264#issuecomment-1119516900 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Work logged] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12020?focusedWorklogId=767137=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767137 ] ASF GitHub Bot logged work on HADOOP-12020: --- Author: ASF GitHub Bot

[GitHub] [hadoop] monthonk commented on pull request #3877: HADOOP-12020. Add configurable storage class option

2022-05-06 Thread GitBox
monthonk commented on PR #3877: URL: https://github.com/apache/hadoop/pull/3877#issuecomment-1119495996 Tested in `eu-west-1`, no errors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] kokonguyen191 commented on a diff in pull request #4199: HDFS-14750. RBF: Support dynamic handler allocation in routers

2022-05-06 Thread GitBox
kokonguyen191 commented on code in PR #4199: URL: https://github.com/apache/hadoop/pull/4199#discussion_r866709948 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/fairness/TestDynamicRouterRpcFairnessPolicyController.java: ## @@

[GitHub] [hadoop] zhangxiping1 opened a new pull request, #4269: HDFS-16570 RBF: The router using MultipleDestinationMountTableResolve…

2022-05-06 Thread GitBox
zhangxiping1 opened a new pull request, #4269: URL: https://github.com/apache/hadoop/pull/4269 The router using MultipleDestinationMountTableResolver remove Multiple subcluster data under the mount point failed -- This is an automated message from the Apache Git

[GitHub] [hadoop] hadoop-yetus commented on pull request #4265: YARN-11126. ZKConfigurationStore Java deserialisation vulnerability

2022-05-06 Thread GitBox
hadoop-yetus commented on PR #4265: URL: https://github.com/apache/hadoop/pull/4265#issuecomment-1119451479 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ferhui commented on a diff in pull request #4199: HDFS-14750. RBF: Support dynamic handler allocation in routers

2022-05-06 Thread GitBox
ferhui commented on code in PR #4199: URL: https://github.com/apache/hadoop/pull/4199#discussion_r866622590 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/fairness/DynamicRouterRpcFairnessPolicyController.java: ## @@ -0,0 +1,139 @@

[GitHub] [hadoop] tomicooler commented on a diff in pull request #4265: YARN-11126. ZKConfigurationStore Java deserialisation vulnerability

2022-05-06 Thread GitBox
tomicooler commented on code in PR #4265: URL: https://github.com/apache/hadoop/pull/4265#discussion_r866530549 ##

[jira] [Work logged] (HADOOP-18193) Support nested mount points in INodeTree

2022-05-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18193?focusedWorklogId=767029=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-767029 ] ASF GitHub Bot logged work on HADOOP-18193: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajith commented on a diff in pull request #4181: HADOOP-18193:Support nested mount points in INodeTree

2022-05-06 Thread GitBox
virajith commented on code in PR #4181: URL: https://github.com/apache/hadoop/pull/4181#discussion_r866488045 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/InodeTree.java: ## @@ -212,6 +227,43 @@ void addLink(final String pathComponent, final

[GitHub] [hadoop] tomscut commented on a diff in pull request #4264: HDFS-16568. dfsadmin -reconfig option to start/query reconfig on all live datanodes

2022-05-06 Thread GitBox
tomscut commented on code in PR #4264: URL: https://github.com/apache/hadoop/pull/4264#discussion_r866512560 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/DFSAdmin.java: ## @@ -1915,12 +1919,57 @@ public int reconfig(String[] argv, int i) throws