[GitHub] [hadoop] hadoop-yetus commented on pull request #5946: YARN-11154. Make router support proxy server.

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5946: URL: https://github.com/apache/hadoop/pull/5946#issuecomment-1680002106 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5946: YARN-11154. Make router support proxy server.

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5946: URL: https://github.com/apache/hadoop/pull/5946#issuecomment-1679992539 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] haiyang1987 commented on pull request #5845: HDFS-17087. Add Throttler for datanode reading block

2023-08-15 Thread via GitHub
haiyang1987 commented on PR #5845: URL: https://github.com/apache/hadoop/pull/5845#issuecomment-1679983648 During rebase, it was found that HDFS-17113 made some changes to the code, the code modified here and support for reconfig read bandwidth logic . Sir @Hexiaoqiao @ayushtkn @to

[GitHub] [hadoop] chunyiyang opened a new pull request, #5951: HDFS-17156. mapreduce job encounters java.io.IOException

2023-08-15 Thread via GitHub
chunyiyang opened a new pull request, #5951: URL: https://github.com/apache/hadoop/pull/5951 ### Description of PR By moving `call.setRpcResponse` after `call.alignmentContext.receiveResponseState(header)`, it guarantees that router sends a response to the client only after recei

[jira] [Commented] (HADOOP-18820) AWS SDK v2: make the v1 bridging support optional

2023-08-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754857#comment-17754857 ] ASF GitHub Bot commented on HADOOP-18820: - hadoop-yetus commented on PR #5872:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5872: HADOOP-18820. Cut AWS v1 support

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5872: URL: https://github.com/apache/hadoop/pull/5872#issuecomment-1679968873 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] zhengchenyu commented on a diff in pull request #5946: YARN-11154. Make router support proxy server.

2023-08-15 Thread via GitHub
zhengchenyu commented on code in PR #5946: URL: https://github.com/apache/hadoop/pull/5946#discussion_r1295313354 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/RouterClientRMService.java: #

[GitHub] [hadoop] zhengchenyu commented on a diff in pull request #5946: YARN-11154. Make router support proxy server.

2023-08-15 Thread via GitHub
zhengchenyu commented on code in PR #5946: URL: https://github.com/apache/hadoop/pull/5946#discussion_r1295313293 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/RouterClientRMService.java: #

[GitHub] [hadoop] tomscut commented on pull request #5845: HDFS-17087. Add Throttler for datanode reading block

2023-08-15 Thread via GitHub
tomscut commented on PR #5845: URL: https://github.com/apache/hadoop/pull/5845#issuecomment-1679853101 > Thanks sir @Hexiaoqiao @ayushtkn @tomscut help me review it. > > Could you please help merge to trunk when you have free time ? Thanks a lot~ Since it's been a long time, ca

[GitHub] [hadoop] zhangxiping1 commented on a diff in pull request #5921: HDFS-17138 RBF: We changed the hadoop.security.auth_to_local configur…

2023-08-15 Thread via GitHub
zhangxiping1 commented on code in PR #5921: URL: https://github.com/apache/hadoop/pull/5921#discussion_r1295294855 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/security/TestDelegationToken.java: ## @@ -376,4 +382,61 @@ public void testDelegationTokenId

[GitHub] [hadoop] slfan1989 commented on pull request #5515: YARN-11037. Add configurable logic to split resource request to the least loaded SC.

2023-08-15 Thread via GitHub
slfan1989 commented on PR #5515: URL: https://github.com/apache/hadoop/pull/5515#issuecomment-1679784468 @goiri Thank you very much for your help in reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [hadoop] hadoop-yetus commented on pull request #5204: HDFS-16864. Drop cache behind entire block on close

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5204: URL: https://github.com/apache/hadoop/pull/5204#issuecomment-1679740737 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] goiri commented on a diff in pull request #5905: [YARN-11421] Graceful Decommission ignores launched containers and gets deactivated before timeout

2023-08-15 Thread via GitHub
goiri commented on code in PR #5905: URL: https://github.com/apache/hadoop/pull/5905#discussion_r1295183661 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/DecommissioningNodesWatcher.ja

[GitHub] [hadoop] goiri commented on a diff in pull request #5921: HDFS-17138 RBF: We changed the hadoop.security.auth_to_local configur…

2023-08-15 Thread via GitHub
goiri commented on code in PR #5921: URL: https://github.com/apache/hadoop/pull/5921#discussion_r1295083257 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/security/TestDelegationToken.java: ## @@ -376,4 +382,61 @@ public void testDelegationTokenIdentifie

[GitHub] [hadoop] goiri commented on a diff in pull request #5921: HDFS-17138 RBF: We changed the hadoop.security.auth_to_local configur…

2023-08-15 Thread via GitHub
goiri commented on code in PR #5921: URL: https://github.com/apache/hadoop/pull/5921#discussion_r1295084050 ## hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/security/TestDelegationToken.java: ## @@ -376,4 +382,61 @@ public void testDelegationTokenIdentifie

[GitHub] [hadoop] goiri merged pull request #5515: YARN-11037. Add configurable logic to split resource request to the least loaded SC.

2023-08-15 Thread via GitHub
goiri merged PR #5515: URL: https://github.com/apache/hadoop/pull/5515 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.

[GitHub] [hadoop] hadoop-yetus commented on pull request #5950: Bump org.apache.maven:maven-core from 3.0.5 to 3.8.1 in /hadoop-maven-plugins

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5950: URL: https://github.com/apache/hadoop/pull/5950#issuecomment-1679482829 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18487) protobuf-2.5.0 dependencies => provided

2023-08-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754743#comment-17754743 ] ASF GitHub Bot commented on HADOOP-18487: - steveloughran commented on PR #4996:

[GitHub] [hadoop] steveloughran commented on pull request #4996: HADOOP-18487. protobuf 2.5.0 marked as provided.

2023-08-15 Thread via GitHub
steveloughran commented on PR #4996: URL: https://github.com/apache/hadoop/pull/4996#issuecomment-1679420033 the failing tests are the usual "tests that fail" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hadoop] dependabot[bot] opened a new pull request, #5950: Bump org.apache.maven:maven-core from 3.0.5 to 3.8.1 in /hadoop-maven-plugins

2023-08-15 Thread via GitHub
dependabot[bot] opened a new pull request, #5950: URL: https://github.com/apache/hadoop/pull/5950 Bumps [org.apache.maven:maven-core](https://github.com/apache/maven) from 3.0.5 to 3.8.1. Commits https://github.com/apache/maven/commit/05c21c65bdfed0f71a2f2ada8b84da59348c4c5d";>

[jira] [Commented] (HADOOP-18845) Add ability to configure ConnectionTTL of http connections while creating S3 Client.

2023-08-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754718#comment-17754718 ] ASF GitHub Bot commented on HADOOP-18845: - mukund-thakur commented on code in P

[GitHub] [hadoop] mukund-thakur commented on a diff in pull request #5948: HADOOP-18845. Add ability to configure s3 connection ttl

2023-08-15 Thread via GitHub
mukund-thakur commented on code in PR #5948: URL: https://github.com/apache/hadoop/pull/5948#discussion_r1294714622 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java: ## @@ -154,6 +156,11 @@ private Constants() { public static final String MAXIM

[GitHub] [hadoop] goiri commented on a diff in pull request #5946: YARN-11154. Make router support proxy server.

2023-08-15 Thread via GitHub
goiri commented on code in PR #5946: URL: https://github.com/apache/hadoop/pull/5946#discussion_r1294841343 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/clientrm/RouterClientRMService.java: ##

[jira] [Commented] (HADOOP-18328) S3A supports S3 on Outposts

2023-08-15 Thread Yuting Chen (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754701#comment-17754701 ] Yuting Chen commented on HADOOP-18328: -- Tested with S3Outpost manually with the en

[GitHub] [hadoop] hadoop-yetus commented on pull request #5949: HDFS-17159.Can't decode Identifier HDFS tokens with only the hdfs client jar

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5949: URL: https://github.com/apache/hadoop/pull/5949#issuecomment-1679164011 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] slfan1989 commented on pull request #5905: [YARN-11421] Graceful Decommission ignores launched containers and gets deactivated before timeout

2023-08-15 Thread via GitHub
slfan1989 commented on PR #5905: URL: https://github.com/apache/hadoop/pull/5905#issuecomment-1679158298 @abhishekd0907 Thank you for your contribution! If there are no other comments, I will merge this PR into the trunk branch after 3 days. -- This is an automated message from the Apache

[jira] [Created] (HADOOP-18849) remove head bucket request from calls which can be made without audit header

2023-08-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18849: --- Summary: remove head bucket request from calls which can be made without audit header Key: HADOOP-18849 URL: https://issues.apache.org/jira/browse/HADOOP-18849

[GitHub] [hadoop] zhuzilong2013 opened a new pull request, #5949: HDFS-17159.Can't decode Identifier HDFS tokens with only the hdfs client jar

2023-08-15 Thread via GitHub
zhuzilong2013 opened a new pull request, #5949: URL: https://github.com/apache/hadoop/pull/5949 ### Description of PR It looks like the meta inf file for the BlockTokenIdentifier is in the hadoop-hdfs.jar rather then the hadoop-hdfs-client.jar. This prevents a client from decode identifi

[GitHub] [hadoop] haiyang1987 commented on pull request #5845: HDFS-17087. Add Throttler for datanode reading block

2023-08-15 Thread via GitHub
haiyang1987 commented on PR #5845: URL: https://github.com/apache/hadoop/pull/5845#issuecomment-1678836428 Thanks sir @Hexiaoqiao @ayushtkn @tomscut help me review it. Could you please help merge to trunk when you have free time ? Thanks a lot~ -- This is an automated message from t

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5937: HDFS-17150. EC: Fix the bug of failed lease recovery.

2023-08-15 Thread via GitHub
Hexiaoqiao commented on PR #5937: URL: https://github.com/apache/hadoop/pull/5937#issuecomment-1678808788 Committed to trunk. Thanks @zhangshuyan0 for your works. And @haiyang1987 , @hfutatzhanghb for your reviews! -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] Hexiaoqiao merged pull request #5937: HDFS-17150. EC: Fix the bug of failed lease recovery.

2023-08-15 Thread via GitHub
Hexiaoqiao merged PR #5937: URL: https://github.com/apache/hadoop/pull/5937 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[GitHub] [hadoop] hadoop-yetus commented on pull request #5855: HDFS-17093. In the case of all datanodes sending FBR when the namenode restarts (large clusters), there is an issue with incomplete bloc

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5855: URL: https://github.com/apache/hadoop/pull/5855#issuecomment-167803 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18487) protobuf-2.5.0 dependencies => provided

2023-08-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754576#comment-17754576 ] ASF GitHub Bot commented on HADOOP-18487: - hadoop-yetus commented on PR #4996:

[GitHub] [hadoop] hadoop-yetus commented on pull request #4996: HADOOP-18487. protobuf 2.5.0 marked as provided.

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #4996: URL: https://github.com/apache/hadoop/pull/4996#issuecomment-1678769749 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] haiyang1987 commented on pull request #5937: HDFS-17150. EC: Fix the bug of failed lease recovery.

2023-08-15 Thread via GitHub
haiyang1987 commented on PR #5937: URL: https://github.com/apache/hadoop/pull/5937#issuecomment-1678720922 LGTM. +1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] abhishekd0907 commented on pull request #5905: [YARN-11421] Graceful Decommission ignores launched containers and gets deactivated before timeout

2023-08-15 Thread via GitHub
abhishekd0907 commented on PR #5905: URL: https://github.com/apache/hadoop/pull/5905#issuecomment-1678612711 @slfan1989 styling issues are fixed. Can you please check the PR again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [hadoop] abhishekd0907 closed pull request #5905: [YARN-11421] Graceful Decommission ignores launched containers and gets deactivated before timeout

2023-08-15 Thread via GitHub
abhishekd0907 closed pull request #5905: [YARN-11421] Graceful Decommission ignores launched containers and gets deactivated before timeout URL: https://github.com/apache/hadoop/pull/5905 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] hadoop-yetus commented on pull request #5905: [YARN-11421] Graceful Decommission ignores launched containers and gets deactivated before timeout

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5905: URL: https://github.com/apache/hadoop/pull/5905#issuecomment-1678603306 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5937: HDFS-17150. EC: Fix the bug of failed lease recovery.

2023-08-15 Thread via GitHub
hadoop-yetus commented on PR #5937: URL: https://github.com/apache/hadoop/pull/5937#issuecomment-1678509228 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe