[GitHub] [hadoop] hadoop-yetus commented on pull request #5648: HDFS-17008. Fix RBF JDK 11 javadoc warnings

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5648: URL: https://github.com/apache/hadoop/pull/5648#issuecomment-1545090106 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] LiuGuH commented on pull request #5642: HDFS-17007. TestPendingReconstruction.testProcessPendingReconstructions verify HDFS-11960 test case is wrong

2023-05-11 Thread via GitHub
LiuGuH commented on PR #5642: URL: https://github.com/apache/hadoop/pull/5642#issuecomment-1545058013 > [HDFS-15086](https://issues.apache.org/jira/browse/HDFS-15086) changed storedBlock to blockInfo without any specific reason. > > > (1) It does not stop

[GitHub] [hadoop] LiuGuH commented on pull request #5642: HDFS-17007. TestPendingReconstruction.testProcessPendingReconstructions verify HDFS-11960 test case is wrong

2023-05-11 Thread via GitHub
LiuGuH commented on PR #5642: URL: https://github.com/apache/hadoop/pull/5642#issuecomment-1545057769 GenericTestUtils.waitFor(() -> pendingReconstruction.size() == 0, 500, 1); // The pending queue should be empty. assertEquals("Size of

[GitHub] [hadoop] zhtttylz commented on pull request #5628: HDFS-17001. Support getStatus API in WebHDFS

2023-05-11 Thread via GitHub
zhtttylz commented on PR #5628: URL: https://github.com/apache/hadoop/pull/5628#issuecomment-1545039162 @ayushtkn Thank you very much for your valuable suggestion. We will create a ticket to add this feature to HTTPFs! -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] zhtttylz commented on pull request #5602: HDFS-16990. HttpFS Add Support getFileLinkStatus API

2023-05-11 Thread via GitHub
zhtttylz commented on PR #5602: URL: https://github.com/apache/hadoop/pull/5602#issuecomment-1545026505 @ayushtkn @slfan1989 Thank you for your assistance in reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5645: YARN-8898. Fix FederationInterceptor#allocate to set application priority in allocateResponse.

2023-05-11 Thread via GitHub
slfan1989 commented on code in PR #5645: URL: https://github.com/apache/hadoop/pull/5645#discussion_r1191852103 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common/src/main/java/org/apache/hadoop/yarn/server/uam/UnmanagedAMPoolManager.java: ## @@

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5636: YARN-11492. Improve createJerseyClient#setConnectTimeout Code.

2023-05-11 Thread via GitHub
slfan1989 commented on code in PR #5636: URL: https://github.com/apache/hadoop/pull/5636#discussion_r1191851956 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/RouterWebServiceUtil.java:

[GitHub] [hadoop] zhtttylz commented on a diff in pull request #5628: HDFS-17001. Support getStatus API in WebHDFS

2023-05-11 Thread via GitHub
zhtttylz commented on code in PR #5628: URL: https://github.com/apache/hadoop/pull/5628#discussion_r1191851916 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java: ## @@ -2255,6 +2256,40 @@ public void testFileLinkStatus() throws

[GitHub] [hadoop] slfan1989 commented on pull request #5625: YARN-3660. BackPort [GPG] Federation Global Policy Generator (service hook only).

2023-05-11 Thread via GitHub
slfan1989 commented on PR #5625: URL: https://github.com/apache/hadoop/pull/5625#issuecomment-1545019378 > The PR itself looks good. How are we going to manage the rebase of the other branch after merging this? @goiri Thank you very much for reviewing the code! The YARN-7402 branch

[GitHub] [hadoop] YuanbenWang commented on pull request #5520: HDFS-16965. Add switch to decide whether to enable native codec.

2023-05-11 Thread via GitHub
YuanbenWang commented on PR #5520: URL: https://github.com/apache/hadoop/pull/5520#issuecomment-1545017444 Thank you for the ticket and merging. Looking forward to meeting you in the next PR. @ayushtkn -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] LiuGuH commented on pull request #5552: HDFS-16979. RBF: Add proxyuser port in hdfsauditlog

2023-05-11 Thread via GitHub
LiuGuH commented on PR #5552: URL: https://github.com/apache/hadoop/pull/5552#issuecomment-1545015145 > The new code looks good to me. > > @LiuGuH for future changes, please keep the commit history so people can see the changes between reviews. > The new code looks

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5648: HDFS-17008. Fix RBF JDK 11 javadoc warnings

2023-05-11 Thread via GitHub
virajjasani commented on code in PR #5648: URL: https://github.com/apache/hadoop/pull/5648#discussion_r1191846344 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/Router.java: ## @@ -670,6 +670,9 @@ public RouterServiceState

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #5628: HDFS-17001. Support getStatus API in WebHDFS

2023-05-11 Thread via GitHub
slfan1989 commented on code in PR #5628: URL: https://github.com/apache/hadoop/pull/5628#discussion_r1191845826 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java: ## @@ -2255,6 +2256,40 @@ public void testFileLinkStatus() throws

[GitHub] [hadoop] hadoop-yetus commented on pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5644: URL: https://github.com/apache/hadoop/pull/5644#issuecomment-1545008902 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5644: URL: https://github.com/apache/hadoop/pull/5644#issuecomment-1545004586 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18709) Add curator based ZooKeeper communication support over SSL/TLS into the common library

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721950#comment-17721950 ] ASF GitHub Bot commented on HADOOP-18709: - szilard-nemeth commented on PR #5638: URL:

[jira] [Commented] (HADOOP-18709) Add curator based ZooKeeper communication support over SSL/TLS into the common library

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721948#comment-17721948 ] ASF GitHub Bot commented on HADOOP-18709: - szilard-nemeth commented on code in PR #5638: URL:

[GitHub] [hadoop] szilard-nemeth commented on pull request #5638: HADOOP-18709. Add curator based ZooKeeper communication support over…

2023-05-11 Thread via GitHub
szilard-nemeth commented on PR #5638: URL: https://github.com/apache/hadoop/pull/5638#issuecomment-1544898512 Thanks for the patch @ferdelyi, good job. Added some comments / questions. Could you please add testing evidence to the Jira? To document how this was tested on a real

[GitHub] [hadoop] goiri commented on a diff in pull request #5648: HDFS-17008. Fix RBF JDK 11 javadoc warnings

2023-05-11 Thread via GitHub
goiri commented on code in PR #5648: URL: https://github.com/apache/hadoop/pull/5648#discussion_r1191783244 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/RouterRpcClient.java: ## @@ -484,14 +486,14 @@ private RetryDecision

[GitHub] [hadoop] szilard-nemeth commented on a diff in pull request #5638: HADOOP-18709. Add curator based ZooKeeper communication support over…

2023-05-11 Thread via GitHub
szilard-nemeth commented on code in PR #5638: URL: https://github.com/apache/hadoop/pull/5638#discussion_r1191770472 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/curator/ZKCuratorManager.java: ## @@ -157,12 +175,44 @@ public void start(List

[jira] [Updated] (HADOOP-18603) NPE in LdapAuthenticationHandler as disableHostNameVerification is never initialized

2023-05-11 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-18603: -- Description: Steps to reproduce this issue: Enable ldap auth with tls by configuring these

[GitHub] [hadoop] szilard-nemeth commented on pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
szilard-nemeth commented on PR #5644: URL: https://github.com/apache/hadoop/pull/5644#issuecomment-1544801015 Thanks @tomicooler for working on this. Given the detailed description, I can understand the context easily. Patch LGTM, committed to trunk -- This is an automated message

[GitHub] [hadoop] ayushtkn merged pull request #5520: HDFS-16965. Add switch to decide whether to enable native codec.

2023-05-11 Thread via GitHub
ayushtkn merged PR #5520: URL: https://github.com/apache/hadoop/pull/5520 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] simbadzina commented on a diff in pull request #5648: HDFS-17008. Fix RBF JDK 11 javadoc warnings

2023-05-11 Thread via GitHub
simbadzina commented on code in PR #5648: URL: https://github.com/apache/hadoop/pull/5648#discussion_r1191736478 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/router/Router.java: ## @@ -670,6 +670,9 @@ public RouterServiceState

[jira] [Commented] (HADOOP-18291) SingleFilePerBlockCache does not have a limit

2023-05-11 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721927#comment-17721927 ] Viraj Jasani commented on HADOOP-18291: --- created HADOOP-18740 for cache file access to go through

[jira] [Created] (HADOOP-18740) s3a prefetch cache blocks should be accessed by RW locks

2023-05-11 Thread Viraj Jasani (Jira)
Viraj Jasani created HADOOP-18740: - Summary: s3a prefetch cache blocks should be accessed by RW locks Key: HADOOP-18740 URL: https://issues.apache.org/jira/browse/HADOOP-18740 Project: Hadoop Common

[GitHub] [hadoop] virajjasani opened a new pull request, #5648: HDFS-17008. Fix RBF JDK 11 javadoc warnings

2023-05-11 Thread via GitHub
virajjasani opened a new pull request, #5648: URL: https://github.com/apache/hadoop/pull/5648 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [hadoop] sodonnel commented on pull request #5643: HDFS-17003. Erasure coding: invalidate wrong block after reporting bad blocks from datanode

2023-05-11 Thread via GitHub
sodonnel commented on PR #5643: URL: https://github.com/apache/hadoop/pull/5643#issuecomment-1544680459 If I understand correctly, for a replicated block, if there are two corrupt block the code in InvalidateCorruptReplicas will be called when the block has been replicated correctly. At

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721918#comment-17721918 ] ASF GitHub Bot commented on HADOOP-18724: - hadoop-yetus commented on PR #5647: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5647: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem (#5611)

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5647: URL: https://github.com/apache/hadoop/pull/5647#issuecomment-1544675058 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] goiri commented on a diff in pull request #5645: YARN-8898. Fix FederationInterceptor#allocate to set application priority in allocateResponse.

2023-05-11 Thread via GitHub
goiri commented on code in PR #5645: URL: https://github.com/apache/hadoop/pull/5645#discussion_r1191576231 ##

[jira] [Commented] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721908#comment-17721908 ] ASF GitHub Bot commented on HADOOP-18688: - hadoop-yetus commented on PR #5621: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5621: HADOOP-18688. S3A audit info to include num of items in delete ops

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5621: URL: https://github.com/apache/hadoop/pull/5621#issuecomment-1544646451 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] goiri commented on pull request #5625: YARN-3660. BackPort [GPG] Federation Global Policy Generator (service hook only).

2023-05-11 Thread via GitHub
goiri commented on PR #5625: URL: https://github.com/apache/hadoop/pull/5625#issuecomment-1544646264 The PR itself looks good. How are we going to manage the rebase of the other branch after merging this? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] goiri commented on a diff in pull request #5636: YARN-11492. Improve createJerseyClient#setConnectTimeout Code.

2023-05-11 Thread via GitHub
goiri commented on code in PR #5636: URL: https://github.com/apache/hadoop/pull/5636#discussion_r1191569769 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/webapp/RouterWebServiceUtil.java: ## @@

[jira] [Commented] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721862#comment-17721862 ] ASF GitHub Bot commented on HADOOP-18688: - virajjasani commented on PR #5621: URL:

[GitHub] [hadoop] virajjasani commented on pull request #5621: HADOOP-18688. S3A audit info to include num of items in delete ops

2023-05-11 Thread via GitHub
virajjasani commented on PR #5621: URL: https://github.com/apache/hadoop/pull/5621#issuecomment-1544462844 thanks for the review Steve!! addressed latest review comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Assigned] (HADOOP-18291) SingleFilePerBlockCache does not have a limit

2023-05-11 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HADOOP-18291: - Assignee: Viraj Jasani > SingleFilePerBlockCache does not have a limit >

[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests when disabled

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721856#comment-17721856 ] ASF GitHub Bot commented on HADOOP-18695: - steveloughran commented on PR #5548: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5548: HADOOP-18695. S3A: reject multipart copy requests when disabled

2023-05-11 Thread via GitHub
steveloughran commented on PR #5548: URL: https://github.com/apache/hadoop/pull/5548#issuecomment-1544402598 when backporting need to move test to optLong as added in #5611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721855#comment-17721855 ] ASF GitHub Bot commented on HADOOP-18724: - steveloughran commented on PR #5647: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5647: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem (#5611)

2023-05-11 Thread via GitHub
steveloughran commented on PR #5647: URL: https://github.com/apache/hadoop/pull/5647#issuecomment-1544400733 test with -Dparallel-tests -DtestsThreadCount=8 -Dscale no failures. note, recent changes in trunk and huge file upload didn't merge, when HADOOP-18695. S3A: reject multipart

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721852#comment-17721852 ] ASF GitHub Bot commented on HADOOP-18724: - steveloughran opened a new pull request, #5647: URL:

[GitHub] [hadoop] steveloughran opened a new pull request, #5647: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem (#5611)

2023-05-11 Thread via GitHub
steveloughran opened a new pull request, #5647: URL: https://github.com/apache/hadoop/pull/5647 This: 1. Adds optLong, optDouble, mustLong and mustDouble methods to the FSBuilder interface to let callers explicitly passin long and double arguments. 2. The opt() and must()

[GitHub] [hadoop] steveloughran merged pull request #5611: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread via GitHub
steveloughran merged PR #5611: URL: https://github.com/apache/hadoop/pull/5611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721849#comment-17721849 ] ASF GitHub Bot commented on HADOOP-18724: - steveloughran merged PR #5611: URL:

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721846#comment-17721846 ] ASF GitHub Bot commented on HADOOP-18724: - steveloughran commented on PR #5611: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5611: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread via GitHub
steveloughran commented on PR #5611: URL: https://github.com/apache/hadoop/pull/5611#issuecomment-1544332942 yarn bower build failed with network issues; 100% unrelated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] hadoop-yetus commented on pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5644: URL: https://github.com/apache/hadoop/pull/5644#issuecomment-1544279312 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5646: Hadoop 18706 branch 3.3

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5646: URL: https://github.com/apache/hadoop/pull/5646#issuecomment-1544252241 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721822#comment-17721822 ] ASF GitHub Bot commented on HADOOP-18724: - hadoop-yetus commented on PR #5611: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5611: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5611: URL: https://github.com/apache/hadoop/pull/5611#issuecomment-1544169434 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] cbevard1 commented on pull request #5646: Hadoop 18706 branch 3.3

2023-05-11 Thread via GitHub
cbevard1 commented on PR #5646: URL: https://github.com/apache/hadoop/pull/5646#issuecomment-1544129524 Integration tests were run in us-east-2 with the following options, `-Dparallel-tests -DtestsThreadCount=16 -Dscale` The unit and integration tests added by this pull request all

[GitHub] [hadoop] hadoop-yetus commented on pull request #5643: HDFS-17003. Erasure coding: invalidate wrong block after reporting bad blocks from datanode

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5643: URL: https://github.com/apache/hadoop/pull/5643#issuecomment-1544110986 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5645: YARN-8898. Fix FederationInterceptor#allocate to set application priority in allocateResponse.

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5645: URL: https://github.com/apache/hadoop/pull/5645#issuecomment-1544102476 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] cbevard1 opened a new pull request, #5646: Hadoop 18706 branch 3.3

2023-05-11 Thread via GitHub
cbevard1 opened a new pull request, #5646: URL: https://github.com/apache/hadoop/pull/5646 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[GitHub] [hadoop] hadoop-yetus commented on pull request #5643: HDFS-17003. Erasure coding: invalidate wrong block after reporting bad blocks from datanode

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5643: URL: https://github.com/apache/hadoop/pull/5643#issuecomment-1544059352 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5644: URL: https://github.com/apache/hadoop/pull/5644#issuecomment-1544051417 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hadoop-yetus commented on pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5644: URL: https://github.com/apache/hadoop/pull/5644#issuecomment-1544047480 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] slfan1989 commented on pull request #5625: YARN-3660. BackPort [GPG] Federation Global Policy Generator (service hook only).

2023-05-11 Thread via GitHub
slfan1989 commented on PR #5625: URL: https://github.com/apache/hadoop/pull/5625#issuecomment-1544044559 @goiri Can you help review this pr? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] Likkey closed pull request #5569: HDFS-16697.Add code to check for minimumRedundantVolumes.

2023-05-11 Thread via GitHub
Likkey closed pull request #5569: HDFS-16697.Add code to check for minimumRedundantVolumes. URL: https://github.com/apache/hadoop/pull/5569 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #5645: YARN-8898. Fix FederationInterceptor#allocate to set application priority in allocateResponse.

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5645: URL: https://github.com/apache/hadoop/pull/5645#issuecomment-1543918969 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18724) Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721751#comment-17721751 ] ASF GitHub Bot commented on HADOOP-18724: - steveloughran commented on PR #5611: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5611: HADOOP-18724. Open file fails with NumberFormatException for S3AFileSystem

2023-05-11 Thread via GitHub
steveloughran commented on PR #5611: URL: https://github.com/apache/hadoop/pull/5611#issuecomment-1543896406 ok, pushed up a pr with the fixed imports; if yetus is happy will merge and then backport -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] hadoop-yetus commented on pull request #5515: YARN-11037. Add configurable logic to split resource request to the least loaded SC.

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5515: URL: https://github.com/apache/hadoop/pull/5515#issuecomment-1543863109 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] tomicooler commented on a diff in pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
tomicooler commented on code in PR #5644: URL: https://github.com/apache/hadoop/pull/5644#discussion_r1191047117 ##

[GitHub] [hadoop] YuanbenWang commented on pull request #5520: HDFS-16965. Add switch to decide whether to enable native codec.

2023-05-11 Thread via GitHub
YuanbenWang commented on PR #5520: URL: https://github.com/apache/hadoop/pull/5520#issuecomment-1543813297 @ayushtkn Hello,Would you please help assign the Jira([HDFS-16965](https://issues.apache.org/jira/browse/HDFS-16965)) ticket to me? Could you please help review this PR? -- This

[GitHub] [hadoop] zhtttylz commented on pull request #5628: HDFS-17001. Support getStatus API in WebHDFS

2023-05-11 Thread via GitHub
zhtttylz commented on PR #5628: URL: https://github.com/apache/hadoop/pull/5628#issuecomment-1543800176 @ayushtkn @slfan1989 Could you please help review this PR again? The `Junit Test` error is not caused by our pr. -- This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721735#comment-17721735 ] ASF GitHub Bot commented on HADOOP-18637: - steveloughran commented on PR #5641: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5641: HADOOP-18637. S3A to support upload of files greater than 2 GB using DiskBlocks (#5630)

2023-05-11 Thread via GitHub
steveloughran commented on PR #5641: URL: https://github.com/apache/hadoop/pull/5641#issuecomment-1543792390 1. what was missing from the previous cherrypick? 2. what were the full commands passed in to maven? -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] slfan1989 opened a new pull request, #5645: YARN-8898. Fix FederationInterceptor#allocate to set application priority in allocateResponse.

2023-05-11 Thread via GitHub
slfan1989 opened a new pull request, #5645: URL: https://github.com/apache/hadoop/pull/5645 ### Description of PR JIRA: YARN-8898. Fix FederationInterceptor#allocate to set application priority in allocateResponse. ### How was this patch tested? ### For code

[jira] [Commented] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721730#comment-17721730 ] ASF GitHub Bot commented on HADOOP-18688: - steveloughran commented on code in PR #5621: URL:

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5621: HADOOP-18688. S3A audit info to include num of items in delete ops

2023-05-11 Thread via GitHub
steveloughran commented on code in PR #5621: URL: https://github.com/apache/hadoop/pull/5621#discussion_r1190995547 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/audit/TestHttpReferrerAuditHeader.java: ## @@ -350,6 +335,48 @@ public void

[GitHub] [hadoop] tomicooler commented on a diff in pull request #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
tomicooler commented on code in PR #5644: URL: https://github.com/apache/hadoop/pull/5644#discussion_r1190991579 ##

[jira] [Commented] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721725#comment-17721725 ] ASF GitHub Bot commented on HADOOP-18688: - steveloughran commented on PR #5621: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5621: HADOOP-18688. S3A audit info to include num of items in delete ops

2023-05-11 Thread via GitHub
steveloughran commented on PR #5621: URL: https://github.com/apache/hadoop/pull/5621#issuecomment-1543775384 thanks, just trying to be extra harsh as github was refusing to do the "since last review" option as it couldn't find the last-review commit in the chain. -- This is an

[GitHub] [hadoop] tomicooler opened a new pull request, #5644: YARN-11490. Reverting YARN-11211 and eliminating the use of DefaultMetricsSystem during configuration validation

2023-05-11 Thread via GitHub
tomicooler opened a new pull request, #5644: URL: https://github.com/apache/hadoop/pull/5644 ### Description of PR YARN-11211 broke the JMX QueueMetrics, detailed root cause analysis in the

[jira] [Commented] (HADOOP-18736) Fix '-Dbundle.pmdk' does not take effect, checknative pmdk shows error

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721720#comment-17721720 ] ASF GitHub Bot commented on HADOOP-18736: - hadoop-yetus commented on PR #5635: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5635: HADOOP-18736: Fix '-Dbundle.pmdk' does not take effect, checknative pmdk shows error

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5635: URL: https://github.com/apache/hadoop/pull/5635#issuecomment-1543753278 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] hfutatzhanghb opened a new pull request, #5643: HDFS-17003. Erasure coding: invalidate wrong block after reporting bad blocks from datanode

2023-05-11 Thread via GitHub
hfutatzhanghb opened a new pull request, #5643: URL: https://github.com/apache/hadoop/pull/5643 The description is in HDFS-17003. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] hadoop-yetus commented on pull request #5628: HDFS-17001. Support getStatus API in WebHDFS

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5628: URL: https://github.com/apache/hadoop/pull/5628#issuecomment-1543595966 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] LiuGuH opened a new pull request, #5642: fix verify HDFS-11960 test case in

2023-05-11 Thread via GitHub
LiuGuH opened a new pull request, #5642: URL: https://github.com/apache/hadoop/pull/5642 ### Description of PR TestPendingReconstruction.testProcessPendingReconstructions() verify [HDFS-11960](https://issues.apache.org/jira/browse/HDFS-11960) is wrong. (1) It does not

[GitHub] [hadoop] hadoop-yetus commented on pull request #5640: HADOOP-18739: Parallelize concatenation of distcp chunks of separate files

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5640: URL: https://github.com/apache/hadoop/pull/5640#issuecomment-1543494792 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18739) Parallelize concatenation of distcp chunks of separate files in CopyCommitter

2023-05-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17721660#comment-17721660 ] ASF GitHub Bot commented on HADOOP-18739: - hadoop-yetus commented on PR #5640: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #4990: HDFS-13507. RBF RouterAdmin disable update functionality in add cmd and supports add/update one mount table with different destination

2023-05-11 Thread via GitHub
ayushtkn commented on PR #4990: URL: https://github.com/apache/hadoop/pull/4990#issuecomment-1543449462 @ZanderXu this can be updated the other PR is merged -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] hadoop-yetus commented on pull request #5629: YARN-11489. Fix memory leak of DelegationTokenRenewer futures in Dele…

2023-05-11 Thread via GitHub
hadoop-yetus commented on PR #5629: URL: https://github.com/apache/hadoop/pull/5629#issuecomment-1543449446 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |