Re: [PR] HDFS-17417. [FGL] HeartbeatManager and DatanodeAdminMonitor support fine-grained locking [hadoop]

2024-03-22 Thread via GitHub
huangzhaobo99 commented on code in PR #6656: URL: https://github.com/apache/hadoop/pull/6656#discussion_r1536571168 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -8713,7 +8714,7 @@ void removeXAttr(String src,

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6473: URL: https://github.com/apache/hadoop/pull/6473#issuecomment-2016250984 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] Backport HDFS-17422. Enhance the stability of the unit test TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. [hadoop]

2024-03-22 Thread via GitHub
slfan1989 commented on PR #6657: URL: https://github.com/apache/hadoop/pull/6657#issuecomment-2016134945 @ZanderXu @ferhui merge into HDFS-17384. @dineshchitlangia Thanks for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Backport HDFS-17422. Enhance the stability of the unit test TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. [hadoop]

2024-03-22 Thread via GitHub
slfan1989 merged PR #6657: URL: https://github.com/apache/hadoop/pull/6657 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. [hadoop]

2024-03-22 Thread via GitHub
slfan1989 closed pull request #6473: YARN-11387. [GPG] YARN GPG mistakenly deleted applicationid. URL: https://github.com/apache/hadoop/pull/6473 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Commiting for #194543 - Updating ACL jar format [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6659: URL: https://github.com/apache/hadoop/pull/6659#issuecomment-2016029165 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] MAPREDUCE-7469. NNBench createControlFiles should use thread pool to improve performance. [hadoop]

2024-03-22 Thread via GitHub
slfan1989 merged PR #6463: URL: https://github.com/apache/hadoop/pull/6463 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Backport HDFS-17422. Enhance the stability of the unit test TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. [hadoop]

2024-03-22 Thread via GitHub
slfan1989 commented on PR #6657: URL: https://github.com/apache/hadoop/pull/6657#issuecomment-2016009587 @ZanderXu This is a backport pr that fixes the issues caused by `HDFS-17146 (#6621)` and supports merging into the `HDFS-17384` branch. -- This is an automated message from the Apache

Re: [PR] Add Menu List 3.3.6. [hadoop-site]

2024-03-22 Thread via GitHub
slfan1989 merged PR #56: URL: https://github.com/apache/hadoop-site/pull/56 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Add Menu List 3.3.6. [hadoop-site]

2024-03-22 Thread via GitHub
slfan1989 commented on PR #56: URL: https://github.com/apache/hadoop-site/pull/56#issuecomment-2015968590 @dineshchitlangia Thanks for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-19098) Vector IO: consistent specified rejection of overlapping ranges

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829993#comment-17829993 ] ASF GitHub Bot commented on HADOOP-19098: - mukund-thakur commented on code in PR #6604: URL:

Re: [PR] HADOOP-19098 Vector IO: consistent specified rejection of overlapping ranges [hadoop]

2024-03-22 Thread via GitHub
mukund-thakur commented on code in PR #6604: URL: https://github.com/apache/hadoop/pull/6604#discussion_r1536087673 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/VectoredReadUtils.java: ## @@ -133,26 +172,42 @@ private static void

[jira] [Commented] (HADOOP-19093) Improve rate limiting through ABFS in Manifest Committer

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829983#comment-17829983 ] ASF GitHub Bot commented on HADOOP-19093: - hadoop-yetus commented on PR #6596: URL:

Re: [PR] HADOOP-19093. [ABFS] Improve rate limiting through ABFS in Manifest Committer [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6596: URL: https://github.com/apache/hadoop/pull/6596#issuecomment-2015834975 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19098) Vector IO: consistent specified rejection of overlapping ranges

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829977#comment-17829977 ] ASF GitHub Bot commented on HADOOP-19098: - hadoop-yetus commented on PR #6604: URL:

Re: [PR] HADOOP-19098 Vector IO: consistent specified rejection of overlapping ranges [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6604: URL: https://github.com/apache/hadoop/pull/6604#issuecomment-2015766513 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17408:Reduce the number of quota calculations in FSDirRenameOp [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6653: URL: https://github.com/apache/hadoop/pull/6653#issuecomment-2015692375 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[PR] Commiting for #194543 - Updating ACL jar format [hadoop]

2024-03-22 Thread via GitHub
OpsHubTech opened a new pull request, #6659: URL: https://github.com/apache/hadoop/pull/6659 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. '17799. Your

[jira] [Commented] (HADOOP-19093) Improve rate limiting through ABFS in Manifest Committer

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829910#comment-17829910 ] ASF GitHub Bot commented on HADOOP-19093: - steveloughran commented on PR #6596: URL:

Re: [PR] HADOOP-19093. [ABFS] Improve rate limiting through ABFS in Manifest Committer [hadoop]

2024-03-22 Thread via GitHub
steveloughran commented on PR #6596: URL: https://github.com/apache/hadoop/pull/6596#issuecomment-2015343365 Latest PR adds op-specific capacity multiplication to abfs store; numbers are pretty arbitrary as this is only used in the committer. could be tuned in future. -- This is an

[jira] [Commented] (HADOOP-19093) Improve rate limiting through ABFS in Manifest Committer

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829903#comment-17829903 ] ASF GitHub Bot commented on HADOOP-19093: - steveloughran commented on PR #6596: URL:

Re: [PR] HADOOP-19093. [ABFS] Improve rate limiting through ABFS in Manifest Committer [hadoop]

2024-03-22 Thread via GitHub
steveloughran commented on PR #6596: URL: https://github.com/apache/hadoop/pull/6596#issuecomment-2015315719 testing on an overloaded azure store; hit sime timeouts and an assertion failure in

Re: [PR] Backport HDFS-17422. Enhance the stability of the unit test TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6657: URL: https://github.com/apache/hadoop/pull/6657#issuecomment-2015265305 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18656) ABFS: Support for Pagination in Recursive Directory Delete

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829896#comment-17829896 ] ASF GitHub Bot commented on HADOOP-18656: - steveloughran commented on PR #6409: URL:

Re: [PR] HADOOP-18656: [ABFS] Adding Support for Paginated Delete for Large Directories in HNS Account [hadoop]

2024-03-22 Thread via GitHub
steveloughran commented on PR #6409: URL: https://github.com/apache/hadoop/pull/6409#issuecomment-2015255222 hey, in #6494 i'm drafting a bulk delete API where the caller (iceberg etc) can give a list of file paths for deletion with no guarantees about safety checks, parent dirs existing

[jira] [Commented] (HADOOP-19088) upgrade to jersey-json 1.22.0

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829895#comment-17829895 ] ASF GitHub Bot commented on HADOOP-19088: - pjfanning commented on PR #6626: URL:

Re: [PR] HADOOP-19088. Use jersey-json 1.22.0 (#6585) [hadoop]

2024-03-22 Thread via GitHub
pjfanning commented on PR #6626: URL: https://github.com/apache/hadoop/pull/6626#issuecomment-2015243059 These test failures are caused by the recent protobuf-java upgrade. * hadoop.hdfs.protocol.TestBlockListAsLongs * hadoop.hdfs.server.datanode.TestLargeBlockReport Hadoop

Re: [PR] HDFS-17416. [FGL] Monitor threads in BlockManager.class support fine-grained lock [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6647: URL: https://github.com/apache/hadoop/pull/6647#issuecomment-2015242951 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Created] (HADOOP-19122) testListPathWithValueGreaterThanServerMaximum assert failure on heavily loaded store

2024-03-22 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19122: --- Summary: testListPathWithValueGreaterThanServerMaximum assert failure on heavily loaded store Key: HADOOP-19122 URL: https://issues.apache.org/jira/browse/HADOOP-19122

[jira] [Updated] (HADOOP-19122) [ABFS] testListPathWithValueGreaterThanServerMaximum assert failure on heavily loaded store

2024-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19122: Component/s: test > [ABFS] testListPathWithValueGreaterThanServerMaximum assert failure

[jira] [Updated] (HADOOP-19122) [ABFS] testListPathWithValueGreaterThanServerMaximum assert failure on heavily loaded store

2024-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19122: Summary: [ABFS] testListPathWithValueGreaterThanServerMaximum assert failure on heavily

[jira] [Commented] (HADOOP-19122) testListPathWithValueGreaterThanServerMaximum assert failure on heavily loaded store

2024-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829892#comment-17829892 ] Steve Loughran commented on HADOOP-19122: - {code} [ERROR] Tests run: 5, Failures: 1, Errors:

[jira] [Commented] (HADOOP-19088) upgrade to jersey-json 1.22.0

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829888#comment-17829888 ] ASF GitHub Bot commented on HADOOP-19088: - dineshchitlangia commented on PR #6626: URL:

Re: [PR] HADOOP-19088. Use jersey-json 1.22.0 (#6585) [hadoop]

2024-03-22 Thread via GitHub
dineshchitlangia commented on PR #6626: URL: https://github.com/apache/hadoop/pull/6626#issuecomment-2015183007 @pjfanning could you review the test failures? They don't seem related to your patch. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829885#comment-17829885 ] ASF GitHub Bot commented on HADOOP-19120: - hadoop-yetus commented on PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6633: URL: https://github.com/apache/hadoop/pull/6633#issuecomment-2015155762 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17430. RecoveringBlock will skip no live replicas when get block recovery command. [hadoop]

2024-03-22 Thread via GitHub
dineshchitlangia commented on PR #6635: URL: https://github.com/apache/hadoop/pull/6635#issuecomment-2015146422 I am having trouble with my JIRA account, once that is resolved I will mark the jira as resolved. Thank you. -- This is an automated message from the Apache Git Service. To

Re: [PR] HDFS-17430. RecoveringBlock will skip no live replicas when get block recovery command. [hadoop]

2024-03-22 Thread via GitHub
dineshchitlangia merged PR #6635: URL: https://github.com/apache/hadoop/pull/6635 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-17417. [FGL] HeartbeatManager and DatanodeAdminMonitor support fine-grained locking [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6656: URL: https://github.com/apache/hadoop/pull/6656#issuecomment-2015131812 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17408. Reduce quota calculation times in FSDirRenameOp. [hadoop]

2024-03-22 Thread via GitHub
ThinkerLei commented on PR #6608: URL: https://github.com/apache/hadoop/pull/6608#issuecomment-2015079963 @Hexiaoqiao @dineshchitlangia @zhangshuyan0 @hfutatzhanghb I apologize for not being able to respond in a timely manner recently. Since there are some aspects of the current logic

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829864#comment-17829864 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535516995 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/HttpOperation.java: ## @@ -0,0 +1,510 @@ +/** + * Licensed to the Apache

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829862#comment-17829862 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535503329 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/HttpOperation.java: ## @@ -0,0 +1,510 @@ +/** + * Licensed to the Apache

Re: [PR] HDFS-17423. [FGL] BlockManagerSafeMode supports fine-grained lock [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6645: URL: https://github.com/apache/hadoop/pull/6645#issuecomment-2014991904 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829859#comment-17829859 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535498363 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1512,6 +1515,7 @@ String initializeUserAgent(final

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829858#comment-17829858 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535496869 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsApacheHttpClient.java: ## @@ -0,0 +1,93 @@ +/** + * Licensed to the Apache

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829857#comment-17829857 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535496335 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsApacheHttpClient.java: ## @@ -0,0 +1,93 @@ +/** + * Licensed to the Apache

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829856#comment-17829856 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535488876 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsApacheHttpClient.java: ## @@ -0,0 +1,93 @@ +/** + * Licensed to the Apache

[PR] Add Menu List 3.3.6. [hadoop-site]

2024-03-22 Thread via GitHub
slfan1989 opened a new pull request, #56: URL: https://github.com/apache/hadoop-site/pull/56 Add Menu List 3.3.6. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829855#comment-17829855 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535487950 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsAHCHttpOperation.java: ## @@ -0,0 +1,422 @@ +/** + * Licensed to the Apache

Re: [PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-03-22 Thread via GitHub
steveloughran commented on code in PR #6494: URL: https://github.com/apache/hadoop/pull/6494#discussion_r1535463621 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java: ## @@ -5457,7 +5421,11 @@ public boolean hasPathCapability(final Path path,

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829847#comment-17829847 ] ASF GitHub Bot commented on HADOOP-18679: - steveloughran commented on code in PR #6494: URL:

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829846#comment-17829846 ] ASF GitHub Bot commented on HADOOP-18679: - steveloughran commented on code in PR #6494: URL:

Re: [PR] Change Stable to hadoop 3.3.6. [hadoop-site]

2024-03-22 Thread via GitHub
slfan1989 merged PR #55: URL: https://github.com/apache/hadoop-site/pull/55 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Change Stable to hadoop 3.3.6. [hadoop-site]

2024-03-22 Thread via GitHub
slfan1989 commented on PR #55: URL: https://github.com/apache/hadoop-site/pull/55#issuecomment-2014922010 @Hexiaoqiao Thanks for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] HADOOP-18679. Add API for bulk/paged object deletion [hadoop]

2024-03-22 Thread via GitHub
steveloughran commented on code in PR #6494: URL: https://github.com/apache/hadoop/pull/6494#discussion_r1535462548 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/BulkDeleteOperationCallbacksImpl.java: ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache

Re: [PR] Update Doap Release 3.4.0. [hadoop-site]

2024-03-22 Thread via GitHub
slfan1989 commented on PR #54: URL: https://github.com/apache/hadoop-site/pull/54#issuecomment-2014920539 @Hexiaoqiao Thanks for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Update Doap Release 3.4.0. [hadoop-site]

2024-03-22 Thread via GitHub
slfan1989 merged PR #54: URL: https://github.com/apache/hadoop-site/pull/54 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Commiting for #194543 - Updating ACL jar format [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6658: URL: https://github.com/apache/hadoop/pull/6658#issuecomment-2014912610 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829838#comment-17829838 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829837#comment-17829837 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535437602 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsAHCHttpOperation.java: ## @@ -0,0 +1,422 @@ +/** + * Licensed to the Apache

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535437602 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsAHCHttpOperation.java: ## @@ -0,0 +1,422 @@ +/** + * Licensed to the Apache

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829836#comment-17829836 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535434260 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsAHCHttpOperation.java: ## @@ -0,0 +1,422 @@ +/** + * Licensed to the Apache

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829835#comment-17829835 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535430472 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsAHCHttpOperation.java: ## @@ -0,0 +1,422 @@ +/** + * Licensed to the Apache

Re: [PR] HDFS-17408:Reduce the number of quota calculations in FSDirRenameOp [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6653: URL: https://github.com/apache/hadoop/pull/6653#issuecomment-2014881724 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829819#comment-17829819 ] ASF GitHub Bot commented on HADOOP-19120: - hadoop-yetus commented on PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6633: URL: https://github.com/apache/hadoop/pull/6633#issuecomment-2014816239 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] Commiting for #194543 - Updating ACL jar format [hadoop]

2024-03-22 Thread via GitHub
OpsHubTech closed pull request #6658: Commiting for #194543 - Updating ACL jar format URL: https://github.com/apache/hadoop/pull/6658 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] Commiting for #194543 - Updating ACL jar format [hadoop]

2024-03-22 Thread via GitHub
OpsHubTech opened a new pull request, #6658: URL: https://github.com/apache/hadoop/pull/6658 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[PR] Backport HDFS-17422. Enhance the stability of the unit test TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. [hadoop]

2024-03-22 Thread via GitHub
ZanderXu opened a new pull request, #6657: URL: https://github.com/apache/hadoop/pull/6657 Backport HDFS-17422. Enhance the stability of the unit test TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] HDFS-17415. [FGL] RPCs in NamenodeProtocol support fine-grained lock [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6654: URL: https://github.com/apache/hadoop/pull/6654#issuecomment-2014696366 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17414. [FGL] RPCs in DatanodeProtocol support fine-grained lock [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6649: URL: https://github.com/apache/hadoop/pull/6649#issuecomment-2014652719 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17423. [FGL] BlockManagerSafeMode supports fine-grained lock [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6645: URL: https://github.com/apache/hadoop/pull/6645#issuecomment-2014636880 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17430. RecoveringBlock will skip no live replicas when get block recovery command. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6635: URL: https://github.com/apache/hadoop/pull/6635#issuecomment-2014620711 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17365. EC: Add extra redunency configuration in checkStreamerFailures to prevent data loss. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6517: URL: https://github.com/apache/hadoop/pull/6517#issuecomment-2014617943 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17365. EC: Add extra redunency configuration in checkStreamerFailures to prevent data loss. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6517: URL: https://github.com/apache/hadoop/pull/6517#issuecomment-2014611816 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HDFS-17416. [FGL] Monitor threads in BlockManager.class support fine-grained lock [hadoop]

2024-03-22 Thread via GitHub
ZanderXu commented on PR #6647: URL: https://github.com/apache/hadoop/pull/6647#issuecomment-2014600094 The failed UT `hadoop.hdfs.server.namenode.fgl.TestFineGrainedFSNamesystemLock` can be ignored first. I will create a ticket to make this UT stronger. -- This is an automated

Re: [PR] HDFS-17416. [FGL] Monitor threads in BlockManager.class support fine-grained lock [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6647: URL: https://github.com/apache/hadoop/pull/6647#issuecomment-2014499170 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829761#comment-17829761 ] ASF GitHub Bot commented on HADOOP-19120: - hadoop-yetus commented on PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6633: URL: https://github.com/apache/hadoop/pull/6633#issuecomment-2014472463 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-19120) [ABFS]: ApacheHttpClient adaptation as network library

2024-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17829759#comment-17829759 ] ASF GitHub Bot commented on HADOOP-19120: - anmolanmol1234 commented on code in PR #6633: URL:

Re: [PR] HADOOP-19120. ApacheHttpClient adaptation in ABFS. [hadoop]

2024-03-22 Thread via GitHub
anmolanmol1234 commented on code in PR #6633: URL: https://github.com/apache/hadoop/pull/6633#discussion_r1535118935 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java: ## @@ -363,6 +364,10 @@ public class AbfsConfiguration{

Re: [PR] HDFS-17438. RBF: The latest STANDBY and UNAVAILABLE nn should be the lowest priority. [hadoop]

2024-03-22 Thread via GitHub
hadoop-yetus commented on PR #6655: URL: https://github.com/apache/hadoop/pull/6655#issuecomment-2014450462 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[PR] HDFS-17417. HeartbeatManager and DatanodeAdminMonitor support fine-grained locking [hadoop]

2024-03-22 Thread via GitHub
ZanderXu opened a new pull request, #6656: URL: https://github.com/apache/hadoop/pull/6656 HeartbeatManager and DatanodeAdminMonitor support fine-grained lock. `blockManager.processExtraRedundancyBlocksOnInService(node)` in `stopMaintenance` and `stopDecommission` involves