[jira] [Commented] (HADOOP-18291) S3A prefetch - Implement LRU cache for SingleFilePerBlockCache

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733705#comment-17733705 ] ASF GitHub Bot commented on HADOOP-18291: - virajjasani opened a new pull reques

[GitHub] [hadoop] virajjasani opened a new pull request, #5754: HADOOP-18291. S3A prefetch - Implement thread-safe LRU cache for SingleFilePerBlockCache

2023-06-17 Thread via GitHub
virajjasani opened a new pull request, #5754: URL: https://github.com/apache/hadoop/pull/5754 Jira: HADOOP-18291 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

[jira] [Updated] (HADOOP-18291) S3A prefetch - Implement LRU cache for SingleFilePerBlockCache

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18291: Labels: pull-request-available (was: ) > S3A prefetch - Implement LRU cache for SingleFi

[GitHub] [hadoop] virajjasani commented on pull request #5754: HADOOP-18291. S3A prefetch - Implement thread-safe LRU cache for SingleFilePerBlockCache

2023-06-17 Thread via GitHub
virajjasani commented on PR #5754: URL: https://github.com/apache/hadoop/pull/5754#issuecomment-1595661932 `us-west-2`: ``` $ mvn clean verify -Dparallel-tests -DtestsThreadCount=8 -Dscale -Dprefetch $ mvn clean verify -Dparallel-tests -DtestsThreadCount=8 -Dscale ``` --

[jira] [Commented] (HADOOP-18291) S3A prefetch - Implement LRU cache for SingleFilePerBlockCache

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733712#comment-17733712 ] ASF GitHub Bot commented on HADOOP-18291: - virajjasani commented on PR #5754: U

[GitHub] [hadoop] Hexiaoqiao commented on a diff in pull request #5735: HDFS-17044. Process reported block toInvalidate logic should set the block size to NO_ACK

2023-06-17 Thread via GitHub
Hexiaoqiao commented on code in PR #5735: URL: https://github.com/apache/hadoop/pull/5735#discussion_r1232990215 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java: ## @@ -3295,8 +3295,11 @@ private BlockInfo processR

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5753: HDFS-17050. Erasure coding: fix bug for invalidating duplicated block when two ec block at the same datanode but different storage.

2023-06-17 Thread via GitHub
Hexiaoqiao commented on PR #5753: URL: https://github.com/apache/hadoop/pull/5753#issuecomment-1595666074 Great catch here! I think @zhangshuyan0 should be more proper to involve to take review. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] hfutatzhanghb commented on pull request #5753: HDFS-17050. Erasure coding: fix bug for invalidating duplicated block when two ec block at the same datanode but different storage.

2023-06-17 Thread via GitHub
hfutatzhanghb commented on PR #5753: URL: https://github.com/apache/hadoop/pull/5753#issuecomment-1595669518 > Great catch here! I think @zhangshuyan0 should be more proper to involve to take review. @Hexiaoqiao Sir, thanks a lot for your reply, current modification seems to have so

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5743: HDFS-17049. EC: Fix duplicate block group IDs generated by SequentialBlockGroupIdGenerator.

2023-06-17 Thread via GitHub
Hexiaoqiao commented on PR #5743: URL: https://github.com/apache/hadoop/pull/5743#issuecomment-1595672568 Back to this PR. Considering that blockId/blockGroupId generator is protected by global lock, I think we do not need more `synchronized` protection which has some time cost. However we

[GitHub] [hadoop] zhtttylz commented on pull request #5734: HDFS-17043. HttpFS implementation for getAllErasureCodingPolicies

2023-06-17 Thread via GitHub
zhtttylz commented on PR #5734: URL: https://github.com/apache/hadoop/pull/5734#issuecomment-1595680647 @ayushtkn @slfan1989 Thank you for your assistance in reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] hadoop-yetus commented on pull request #5754: HADOOP-18291. S3A prefetch - Implement thread-safe LRU cache for SingleFilePerBlockCache

2023-06-17 Thread via GitHub
hadoop-yetus commented on PR #5754: URL: https://github.com/apache/hadoop/pull/5754#issuecomment-1595705310 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18291) S3A prefetch - Implement LRU cache for SingleFilePerBlockCache

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733738#comment-17733738 ] ASF GitHub Bot commented on HADOOP-18291: - hadoop-yetus commented on PR #5754:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5716: YARN-11506.The formatted yarn queue list is displayed on CLI

2023-06-17 Thread via GitHub
hadoop-yetus commented on PR #5716: URL: https://github.com/apache/hadoop/pull/5716#issuecomment-1595711258 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] slfan1989 commented on pull request #5716: YARN-11506.The formatted yarn queue list is displayed on CLI

2023-06-17 Thread via GitHub
slfan1989 commented on PR #5716: URL: https://github.com/apache/hadoop/pull/5716#issuecomment-1595774844 @yl09099 Thanks for your contribution! @ayushtkn Thank you for your help reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, ple

[jira] [Commented] (HADOOP-18596) Distcp -update between different cloud stores to use modification time while checking for file skip.

2023-06-17 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733813#comment-17733813 ] Wei-Chiu Chuang commented on HADOOP-18596: -- This change and HADOOP-18633 faile

[GitHub] [hadoop] slfan1989 opened a new pull request, #5755: YARN-11516. [Minor]Improve existsApplicationHomeSubCluster/existsReservationHomeSubCluster Log Level.

2023-06-17 Thread via GitHub
slfan1989 opened a new pull request, #5755: URL: https://github.com/apache/hadoop/pull/5755 ### Description of PR JIRA: YARN-11516. Improve existsApplicationHomeSubCluster/existsReservationHomeSubCluster Log Level. The method FederationStateStoreFacade#existsApplicationHome

[GitHub] [hadoop] haiyang1987 commented on a diff in pull request #5735: HDFS-17044. Process reported block toInvalidate logic should set the block size to NO_ACK

2023-06-17 Thread via GitHub
haiyang1987 commented on code in PR #5735: URL: https://github.com/apache/hadoop/pull/5735#discussion_r1233173275 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java: ## @@ -3295,8 +3295,11 @@ private BlockInfo process

[GitHub] [hadoop] hadoop-yetus commented on pull request #5755: YARN-11516. [Minor]Improve existsApplicationHomeSubCluster/existsReservationHomeSubCluster Log Level.

2023-06-17 Thread via GitHub
hadoop-yetus commented on PR #5755: URL: https://github.com/apache/hadoop/pull/5755#issuecomment-1595925929 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Created] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread Xiaoqiao He (Jira)
Xiaoqiao He created HADOOP-18774: Summary: Add .vscode to gitignore Key: HADOOP-18774 URL: https://issues.apache.org/jira/browse/HADOOP-18774 Project: Hadoop Common Issue Type: Improvement

[GitHub] [hadoop] Hexiaoqiao opened a new pull request, #5756: HADOOP-18774. Add .vscode to gitignore.

2023-06-17 Thread via GitHub
Hexiaoqiao opened a new pull request, #5756: URL: https://github.com/apache/hadoop/pull/5756 ### Description of PR Add .vscode to gitignore. ### How was this patch tested? No. ### For code changes: - [Y] Does the title or this PR starts with the correspondin

[jira] [Commented] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733840#comment-17733840 ] ASF GitHub Bot commented on HADOOP-18774: - Hexiaoqiao opened a new pull request

[jira] [Updated] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18774: Labels: pull-request-available (was: ) > Add .vscode to gitignore >

[GitHub] [hadoop] hadoop-yetus commented on pull request #5756: HADOOP-18774. Add .vscode to gitignore.

2023-06-17 Thread via GitHub
hadoop-yetus commented on PR #5756: URL: https://github.com/apache/hadoop/pull/5756#issuecomment-1595959603 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733851#comment-17733851 ] ASF GitHub Bot commented on HADOOP-18774: - hadoop-yetus commented on PR #5756:

[GitHub] [hadoop] Hexiaoqiao merged pull request #5756: HADOOP-18774. Add .vscode to gitignore.

2023-06-17 Thread via GitHub
Hexiaoqiao merged PR #5756: URL: https://github.com/apache/hadoop/pull/5756 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Commented] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733860#comment-17733860 ] ASF GitHub Bot commented on HADOOP-18774: - Hexiaoqiao merged PR #5756: URL: htt

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5756: HADOOP-18774. Add .vscode to gitignore.

2023-06-17 Thread via GitHub
Hexiaoqiao commented on PR #5756: URL: https://github.com/apache/hadoop/pull/5756#issuecomment-1595976656 Committed to trunk. Thanks @ayushtkn for reviews! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17733861#comment-17733861 ] ASF GitHub Bot commented on HADOOP-18774: - Hexiaoqiao commented on PR #5756: UR

[jira] [Resolved] (HADOOP-18774) Add .vscode to gitignore

2023-06-17 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18774. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add .vscode to gi