Re: [PR] HDFS-17534 RBF: Support leader follower mode for multiple subclusters [hadoop]

2024-06-05 Thread via GitHub
yuanboliu commented on code in PR #6861: URL: https://github.com/apache/hadoop/pull/6861#discussion_r1628863101 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/resolver/order/LeaderFollowerResolver.java: ## @@ -0,0 +1,40 @@ +/* + * L

[jira] [Commented] (HADOOP-19137) [ABFS]:Extra getAcl call while calling the very first API of FileSystem

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852624#comment-17852624 ] ASF GitHub Bot commented on HADOOP-19137: - saxenapranav commented on PR #6752:

Re: [PR] HADOOP-19137. [ABFS]Fail fs init if cpk config is given on non-hns account [hadoop]

2024-06-05 Thread via GitHub
saxenapranav commented on PR #6752: URL: https://github.com/apache/hadoop/pull/6752#issuecomment-2151337202 Thank you @steveloughran very much! Following can be used for the merge commit: Title: Prevent ABFS initialization for non-hierarchal-namespace account if client-provided-key c

Re: [PR] HDFS-17534 RBF: Support leader follower mode for multiple subclusters [hadoop]

2024-06-05 Thread via GitHub
kokonguyen191 commented on code in PR #6861: URL: https://github.com/apache/hadoop/pull/6861#discussion_r1628697623 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/resolver/order/LeaderFollowerResolver.java: ## @@ -0,0 +1,40 @@ +/* +

[jira] [Commented] (HADOOP-19189) ITestS3ACommitterFactory failing

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852554#comment-17852554 ] ASF GitHub Bot commented on HADOOP-19189: - mukund-thakur commented on code in P

Re: [PR] HADOOP-19189. ITestS3ACommitterFactory failing [hadoop]

2024-06-05 Thread via GitHub
mukund-thakur commented on code in PR #6857: URL: https://github.com/apache/hadoop/pull/6857#discussion_r1628384180 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/commit/ITestS3ACommitterFactory.java: ## @@ -72,121 +85,141 @@ public class ITestS3ACommitterFact

[jira] [Commented] (HADOOP-19189) ITestS3ACommitterFactory failing

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852553#comment-17852553 ] ASF GitHub Bot commented on HADOOP-19189: - mukund-thakur commented on code in P

Re: [PR] HADOOP-19189. ITestS3ACommitterFactory failing [hadoop]

2024-06-05 Thread via GitHub
mukund-thakur commented on code in PR #6857: URL: https://github.com/apache/hadoop/pull/6857#discussion_r1628370772 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/commit/ITestS3ACommitterFactory.java: ## @@ -72,121 +85,141 @@ public class ITestS3ACommitterFact

Re: [PR] HADOOP-19193. Create orphan commit for website deployment [hadoop]

2024-06-05 Thread via GitHub
pan3793 commented on PR #6864: URL: https://github.com/apache/hadoop/pull/6864#issuecomment-2150619962 @steveloughran I tested the trunk sync and fresh repo clone, the download size is much more reasonable now. ``` $ git pull remote: Enumerating objects: 5627, done. remote: C

[jira] [Commented] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852520#comment-17852520 ] ASF GitHub Bot commented on HADOOP-19193: - pan3793 commented on PR #6864: URL:

[jira] [Commented] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852517#comment-17852517 ] ASF GitHub Bot commented on HADOOP-19193: - pan3793 commented on PR #6864: URL:

Re: [PR] HADOOP-19193. Create orphan commit for website deployment [hadoop]

2024-06-05 Thread via GitHub
pan3793 commented on PR #6864: URL: https://github.com/apache/hadoop/pull/6864#issuecomment-2150597498 The GitHub Actions workflow is only triggered by pushing commits to the trunk, no backport is required. -- This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Commented] (HADOOP-19186) Change loglevel to ERROR/WARNING so that it would easy to identify the problem without ignoring

2024-06-05 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852512#comment-17852512 ] Srinivasu Majeti commented on HADOOP-19186: --- Hi [~arp] , I think we can print

[jira] [Commented] (HADOOP-19161) S3A: option "fs.s3a.performance.flags" to take list of performance flags

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852498#comment-17852498 ] ASF GitHub Bot commented on HADOOP-19161: - hadoop-yetus commented on PR #6789:

Re: [PR] HADOOP-19161. S3A: option "fs.s3a.performance.flags" to take list of performance flags [hadoop]

2024-06-05 Thread via GitHub
hadoop-yetus commented on PR #6789: URL: https://github.com/apache/hadoop/pull/6789#issuecomment-2150381808 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19186) Change loglevel to ERROR/WARNING so that it would easy to identify the problem without ignoring

2024-06-05 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852491#comment-17852491 ] Arpit Agarwal commented on HADOOP-19186: Hi [~smajeti], this is most likely bei

[jira] [Commented] (HADOOP-19137) [ABFS]:Extra getAcl call while calling the very first API of FileSystem

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852484#comment-17852484 ] ASF GitHub Bot commented on HADOOP-19137: - steveloughran commented on PR #6752:

Re: [PR] HADOOP-19137. [ABFS]Fail fs init if cpk config is given on non-hns account [hadoop]

2024-06-05 Thread via GitHub
steveloughran commented on PR #6752: URL: https://github.com/apache/hadoop/pull/6752#issuecomment-2150247383 @saxenapranav OK, I'm ready to merge. Can you draft a better title for the commit and any minimal text to go in the body? -- This is an automated message from the Apache Git Se

[jira] [Commented] (HADOOP-19148) Update solr from 8.11.2 to 8.11.3 to address CVE-2023-50298

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852480#comment-17852480 ] ASF GitHub Bot commented on HADOOP-19148: - steveloughran commented on PR #6830:

Re: [PR] HADOOP-19148 Upgrade solr from 8.11.2 to 8.11.3 to address CVE-2023-50298 [hadoop]

2024-06-05 Thread via GitHub
steveloughran commented on PR #6830: URL: https://github.com/apache/hadoop/pull/6830#issuecomment-2150221811 lets try again: do a git merge trunk and push up to see what we can do -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[jira] [Commented] (HADOOP-19189) ITestS3ACommitterFactory failing

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852477#comment-17852477 ] ASF GitHub Bot commented on HADOOP-19189: - steveloughran commented on PR #6857:

Re: [PR] HADOOP-19189. ITestS3ACommitterFactory failing [hadoop]

2024-06-05 Thread via GitHub
steveloughran commented on PR #6857: URL: https://github.com/apache/hadoop/pull/6857#issuecomment-2150212874 Seeking feedback from @mukund-thakur @ahmarsuhail @HarshitGupta11 @virajjasani Fixes test failures, nothing else... -- This is an automated message from the Apache Git Serv

[jira] [Updated] (HADOOP-19154) upgrade bouncy castle to 1.78.1 due to CVEs

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19154: Fix Version/s: 3.5.0 > upgrade bouncy castle to 1.78.1 due to CVEs >

[jira] [Commented] (HADOOP-19154) upgrade bouncy castle to 1.78.1 due to CVEs

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852473#comment-17852473 ] ASF GitHub Bot commented on HADOOP-19154: - steveloughran commented on PR #6755:

Re: [PR] HADOOP-19154. Upgrade bouncycastle to 1.78.1 due to CVEs [hadoop]

2024-06-05 Thread via GitHub
steveloughran commented on PR #6755: URL: https://github.com/apache/hadoop/pull/6755#issuecomment-2150195706 presumably we will need this in the older branches... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] HADOOP-19154. Upgrade bouncycastle to 1.78.1 due to CVEs [hadoop]

2024-06-05 Thread via GitHub
steveloughran merged PR #6755: URL: https://github.com/apache/hadoop/pull/6755 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Updated] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19193: Component/s: build > Create orphan commit for website deployment > --

[jira] [Assigned] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-19193: --- Assignee: Cheng Pan > Create orphan commit for website deployment > --

[jira] [Resolved] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19193. - Fix Version/s: 3.5.0 Resolution: Fixed > Create orphan commit for website deploy

[jira] [Commented] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852468#comment-17852468 ] ASF GitHub Bot commented on HADOOP-19193: - steveloughran commented on PR #6864:

Re: [PR] HADOOP-19193. Create orphan commit for website deployment [hadoop]

2024-06-05 Thread via GitHub
steveloughran commented on PR #6864: URL: https://github.com/apache/hadoop/pull/6864#issuecomment-2150168997 merged. do we need to do it for other branches? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852466#comment-17852466 ] ASF GitHub Bot commented on HADOOP-19193: - steveloughran merged PR #6864: URL:

Re: [PR] HADOOP-19193. Create orphan commit for website deployment [hadoop]

2024-06-05 Thread via GitHub
steveloughran merged PR #6864: URL: https://github.com/apache/hadoop/pull/6864 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[jira] [Commented] (HADOOP-19192) Log level is WARN when fail to load native hadoop libs

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852422#comment-17852422 ] ASF GitHub Bot commented on HADOOP-19192: - hadoop-yetus commented on PR #6863:

Re: [PR] HADOOP-19192. Log level is WARN when fail to load native hadoop libs [hadoop]

2024-06-05 Thread via GitHub
hadoop-yetus commented on PR #6863: URL: https://github.com/apache/hadoop/pull/6863#issuecomment-2149677882 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852402#comment-17852402 ] ASF GitHub Bot commented on HADOOP-19193: - hadoop-yetus commented on PR #6864:

Re: [PR] HADOOP-19193. Create orphan commit for website deployment [hadoop]

2024-06-05 Thread via GitHub
hadoop-yetus commented on PR #6864: URL: https://github.com/apache/hadoop/pull/6864#issuecomment-2149574685 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-19058) [JDK-17] Fix UT Failures in hadoop common, hdfs, yarn

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852354#comment-17852354 ] ASF GitHub Bot commented on HADOOP-19058: - pan3793 commented on code in PR #653

Re: [PR] HADOOP-19058. [JDK-17] Fix UT Failures in hadoop common, hdfs, yarn [hadoop]

2024-06-05 Thread via GitHub
pan3793 commented on code in PR #6531: URL: https://github.com/apache/hadoop/pull/6531#discussion_r1627386093 ## hadoop-project/pom.xml: ## @@ -168,7 +168,18 @@ [3.3.0,) --Xmx2048m -XX:+HeapDumpOnOutOfMemoryError +-Xmx2048m -XX:+HeapDumpOnOutOfMemoryError

[jira] [Commented] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852353#comment-17852353 ] ASF GitHub Bot commented on HADOOP-19193: - pan3793 commented on PR #6864: URL:

Re: [PR] HADOOP-19193. Create orphan commit for website deployment [hadoop]

2024-06-05 Thread via GitHub
pan3793 commented on PR #6864: URL: https://github.com/apache/hadoop/pull/6864#issuecomment-2149348761 cc @steveloughran @ayushtkn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Commented] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852351#comment-17852351 ] ASF GitHub Bot commented on HADOOP-19193: - pan3793 opened a new pull request, #

[jira] [Updated] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19193: Labels: pull-request-available (was: ) > Create orphan commit for website deployment > -

[PR] HADOOP-19193. Create orphan commit for website deployment [hadoop]

2024-06-05 Thread via GitHub
pan3793 opened a new pull request, #6864: URL: https://github.com/apache/hadoop/pull/6864 ### Description of PR Currently, the gh-pages deployment always creates new commits based on the previous one, which causes the git repo size to grow fast. According to https://github.com

[jira] [Created] (HADOOP-19193) Create orphan commit for website deployment

2024-06-05 Thread Cheng Pan (Jira)
Cheng Pan created HADOOP-19193: -- Summary: Create orphan commit for website deployment Key: HADOOP-19193 URL: https://issues.apache.org/jira/browse/HADOOP-19193 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-19192) Log level is WARN when fail to load native hadoop libs

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-19192: Labels: pull-request-available (was: ) > Log level is WARN when fail to load native hado

[jira] [Commented] (HADOOP-19192) Log level is WARN when fail to load native hadoop libs

2024-06-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852350#comment-17852350 ] ASF GitHub Bot commented on HADOOP-19192: - pan3793 opened a new pull request, #

[PR] HADOOP-19192. Log level is WARN when fail to load native hadoop libs [hadoop]

2024-06-05 Thread via GitHub
pan3793 opened a new pull request, #6863: URL: https://github.com/apache/hadoop/pull/6863 ### Description of PR Fix log level in docs. ### How was this patch tested? Review. ### For code changes: - [x] Does the title or this PR starts with the corresponding

[jira] [Created] (HADOOP-19192) Log level is WARN when fail to load native hadoop libs

2024-06-05 Thread Cheng Pan (Jira)
Cheng Pan created HADOOP-19192: -- Summary: Log level is WARN when fail to load native hadoop libs Key: HADOOP-19192 URL: https://issues.apache.org/jira/browse/HADOOP-19192 Project: Hadoop Common

Re: [PR] HDFS-16757. Add a new method copyBlockCrossNamespace to DataNode [hadoop]

2024-06-05 Thread via GitHub
haiyang1987 commented on PR #5719: URL: https://github.com/apache/hadoop/pull/5719#issuecomment-2149138284 > Hello ,sirs . For some reason, I now work with fastcopy and current progerss is that I now already finished fastcopy tools in standalone mode. Both replicated files and EC files are

Re: [PR] HDFS-16757. Add a new method copyBlockCrossNamespace to DataNode [hadoop]

2024-06-05 Thread via GitHub
LiuGuH commented on code in PR #5719: URL: https://github.com/apache/hadoop/pull/5719#discussion_r1627144059 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataXceiver.java: ## @@ -1078,6 +1079,44 @@ public void blockGroupChecksum(final S