[jira] [Commented] (HADOOP-18989) Use thread pool to improve the speed of creating control files in TestDFSIO

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790380#comment-17790380 ] ASF GitHub Bot commented on HADOOP-18989: - hfutatzhanghb commented on PR #6294:

[jira] [Updated] (HADOOP-18989) Use thread pool to improve the speed of creating control files in TestDFSIO

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18989: Labels: pull-request-available (was: ) > Use thread pool to improve the speed of creatin

Re: [PR] HADOOP-18989. Use thread pool to improve the speed of creating control files in TestDFSIO [hadoop]

2023-11-27 Thread via GitHub
hfutatzhanghb commented on PR #6294: URL: https://github.com/apache/hadoop/pull/6294#issuecomment-1829213504 > Hi @hfutatzhanghb Thanks for your contribution. Please create JIRA first, then add the JIRA-ID to the title as usual. Thanks. Sir, Thanks for your reminding. Have updated it.

[jira] [Commented] (HADOOP-18959) Use builder for prefetch CachingBlockManager

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790354#comment-17790354 ] ASF GitHub Bot commented on HADOOP-18959: - hadoop-yetus commented on PR #6302:

Re: [PR] HADOOP-18959. Use builder for prefetch CachingBlockManager. (#6240) [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6302: URL: https://github.com/apache/hadoop/pull/6302#issuecomment-1829043274 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HDFS-17263. RBF: Fix client ls trash path cannot get except default nameservices trash path [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6291: URL: https://github.com/apache/hadoop/pull/6291#issuecomment-1829026020 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18959) Use builder for prefetch CachingBlockManager

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790347#comment-17790347 ] ASF GitHub Bot commented on HADOOP-18959: - virajjasani commented on PR #6302: U

Re: [PR] HADOOP-18959. Use builder for prefetch CachingBlockManager. (#6240) [hadoop]

2023-11-27 Thread via GitHub
virajjasani commented on PR #6302: URL: https://github.com/apache/hadoop/pull/6302#issuecomment-1828988579 Tested against `us-west-2` ``` mvn clean verify -Dparallel-tests -DtestsThreadCount=8 -Dscale -Dprefetch ``` -- This is an automated message from the Apache Git Service.

[jira] [Commented] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790342#comment-17790342 ] ASF GitHub Bot commented on HADOOP-18915: - hadoop-yetus commented on PR #6180:

Re: [PR] HADOOP-18915. Tune/extend S3A http connection and thread poool settings [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6180: URL: https://github.com/apache/hadoop/pull/6180#issuecomment-1828954528 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17263. RBF: Fix client ls trash path cannot get except default nameservices trash path [hadoop]

2023-11-27 Thread via GitHub
LiuGuH commented on code in PR #6291: URL: https://github.com/apache/hadoop/pull/6291#discussion_r1406987425 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router/TestRouterTrash.java: ## @@ -227,6 +234,61 @@ public void testMoveToT

[jira] [Commented] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790325#comment-17790325 ] ASF GitHub Bot commented on HADOOP-18915: - hadoop-yetus commented on PR #6180:

Re: [PR] HADOOP-18915. Tune/extend S3A http connection and thread poool settings [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6180: URL: https://github.com/apache/hadoop/pull/6180#issuecomment-1828891187 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790323#comment-17790323 ] ASF GitHub Bot commented on HADOOP-18993: - hadoop-yetus commented on PR #6301:

Re: [PR] HADOOP-18993 Allow to not isolate S3AFileSystem classloader when needed [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6301: URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1828886667 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790320#comment-17790320 ] ASF GitHub Bot commented on HADOOP-18993: - hadoop-yetus commented on PR #6301:

Re: [PR] HADOOP-18993 Allow to not isolate S3AFileSystem classloader when needed [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6301: URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1828878097 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18967) Allow no-downtime migration of HDFS clusters into secure mode

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790319#comment-17790319 ] ASF GitHub Bot commented on HADOOP-18967: - hadoop-yetus commented on PR #6293:

Re: [PR] HADOOP-18967 Allow no-downtime migration of HDFS clusters into secure mode [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6293: URL: https://github.com/apache/hadoop/pull/6293#issuecomment-1828876226 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18959) Use builder for prefetch CachingBlockManager

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790317#comment-17790317 ] ASF GitHub Bot commented on HADOOP-18959: - virajjasani commented on PR #6302: U

[jira] [Commented] (HADOOP-18959) Use builder for prefetch CachingBlockManager

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790318#comment-17790318 ] ASF GitHub Bot commented on HADOOP-18959: - virajjasani commented on PR #6302: U

Re: [PR] HADOOP-18967 Allow no-downtime migration of HDFS clusters into secure mode [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6293: URL: https://github.com/apache/hadoop/pull/6293#issuecomment-1828873393 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18959) Use builder for prefetch CachingBlockManager

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790315#comment-17790315 ] ASF GitHub Bot commented on HADOOP-18959: - virajjasani opened a new pull reques

[jira] [Commented] (HADOOP-18967) Allow no-downtime migration of HDFS clusters into secure mode

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790316#comment-17790316 ] ASF GitHub Bot commented on HADOOP-18967: - hadoop-yetus commented on PR #6293:

Re: [PR] HADOOP-18959. Use builder for prefetch CachingBlockManager. (#6240) [hadoop]

2023-11-27 Thread via GitHub
virajjasani commented on PR #6302: URL: https://github.com/apache/hadoop/pull/6302#issuecomment-1828873892 FYI @ahmarsuhail -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] HADOOP-18959. Use builder for prefetch CachingBlockManager. (#6240) [hadoop]

2023-11-27 Thread via GitHub
virajjasani commented on PR #6302: URL: https://github.com/apache/hadoop/pull/6302#issuecomment-1828873712 Testing in progress -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[PR] HADOOP-18959. Use builder for prefetch CachingBlockManager. (#6240) [hadoop]

2023-11-27 Thread via GitHub
virajjasani opened a new pull request, #6302: URL: https://github.com/apache/hadoop/pull/6302 branch-3.3 backport PR of #6240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790310#comment-17790310 ] ASF GitHub Bot commented on HADOOP-18993: - hadoop-yetus commented on PR #6301:

Re: [PR] HADOOP-18993 Allow to not isolate S3AFileSystem classloader when needed [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6301: URL: https://github.com/apache/hadoop/pull/6301#issuecomment-1828852213 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18967) Allow no-downtime migration of HDFS clusters into secure mode

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790307#comment-17790307 ] ASF GitHub Bot commented on HADOOP-18967: - hadoop-yetus commented on PR #6293:

Re: [PR] HADOOP-18967 Allow no-downtime migration of HDFS clusters into secure mode [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6293: URL: https://github.com/apache/hadoop/pull/6293#issuecomment-1828847496 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18967) Allow no-downtime migration of HDFS clusters into secure mode

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790306#comment-17790306 ] ASF GitHub Bot commented on HADOOP-18967: - hadoop-yetus commented on PR #6293:

Re: [PR] HADOOP-18967 Allow no-downtime migration of HDFS clusters into secure mode [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6293: URL: https://github.com/apache/hadoop/pull/6293#issuecomment-1828842170 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2023-11-27 Thread Antonio Murgia (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790293#comment-17790293 ] Antonio Murgia commented on HADOOP-18993: - [~ste...@apache.org] > Allow to not

[jira] [Commented] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790291#comment-17790291 ] ASF GitHub Bot commented on HADOOP-18915: - hadoop-yetus commented on PR #6180:

Re: [PR] HADOOP-18915. Tune/extend S3A http connection and thread poool settings [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6180: URL: https://github.com/apache/hadoop/pull/6180#issuecomment-1828759344 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790287#comment-17790287 ] ASF GitHub Bot commented on HADOOP-18915: - steveloughran commented on PR #6180:

Re: [PR] HADOOP-18915. Tune/extend S3A http connection and thread poool settings [hadoop]

2023-11-27 Thread via GitHub
steveloughran commented on PR #6180: URL: https://github.com/apache/hadoop/pull/6180#issuecomment-1828731773 tested: s3 london with ` -Dparallel-tests -DtestsThreadCount=8 -Dscale -Dprefetch` took a while to work out why my connection failure test worked standalone and failed in bulk

[jira] [Commented] (HADOOP-17372) S3A AWS Credential provider loading gets confused with isolated classloaders

2023-11-27 Thread Antonio Murgia (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790284#comment-17790284 ] Antonio Murgia commented on HADOOP-17372: - Provided a PR with tests + doc as HA

[jira] [Commented] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790281#comment-17790281 ] ASF GitHub Bot commented on HADOOP-18993: - tmnd1991 opened a new pull request,

[jira] [Updated] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18993: Labels: pull-request-available (was: ) > Allow to not isolate S3AFileSystem classloader

[PR] HADOOP-18993 Allow to not isolate S3AFileSystem classloader when needed [hadoop]

2023-11-27 Thread via GitHub
tmnd1991 opened a new pull request, #6301: URL: https://github.com/apache/hadoop/pull/6301 ### Description of PR In [HADOOP-17372](https://issues.apache.org/jira/browse/HADOOP-17372) the S3AFileSystem forces the configuration classloader to be the same as the one that loaded S3AFileS

[jira] [Created] (HADOOP-18993) Allow to not isolate S3AFileSystem classloader when needed

2023-11-27 Thread Antonio Murgia (Jira)
Antonio Murgia created HADOOP-18993: --- Summary: Allow to not isolate S3AFileSystem classloader when needed Key: HADOOP-18993 URL: https://issues.apache.org/jira/browse/HADOOP-18993 Project: Hadoop Com

Re: [PR] HADOOP-18915. Tune/extend S3A http connection and thread poool settings [hadoop]

2023-11-27 Thread via GitHub
steveloughran commented on code in PR #6180: URL: https://github.com/apache/hadoop/pull/6180#discussion_r1406782216 ## hadoop-common-project/hadoop-common/src/main/resources/core-default.xml: ## @@ -1596,14 +1596,15 @@ fs.s3a.connection.establish.timeout - 5000 - Socket

[jira] [Commented] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790275#comment-17790275 ] ASF GitHub Bot commented on HADOOP-18915: - steveloughran commented on code in P

[jira] [Commented] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790252#comment-17790252 ] ASF GitHub Bot commented on HADOOP-18915: - hadoop-yetus commented on PR #6180:

Re: [PR] HADOOP-18915. Tune S3A http connection settings [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6180: URL: https://github.com/apache/hadoop/pull/6180#issuecomment-1828517594 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11561. [Federation] GPG Supports Format PolicyStateStore. [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6300: URL: https://github.com/apache/hadoop/pull/6300#issuecomment-1828334176 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] YARN-11561. [Federation] GPG Supports Format PolicyStateStore. [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6300: URL: https://github.com/apache/hadoop/pull/6300#issuecomment-1828325737 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HDFS-16791. Add getEnclosingRoot() API to filesystem interface and im… [hadoop]

2023-11-27 Thread via GitHub
mccormickt12 commented on PR #6262: URL: https://github.com/apache/hadoop/pull/6262#issuecomment-1828304048 @steveloughran Let me know if theres any concerns with the current failure, it seems transient / expected to me, but not 100% cc @simbadzina -- This is an automated message from

Re: [PR] YARN-11613. [Federation] Router CLI Supports Delete SubClusterPolicyConfiguration Of Queues. [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6295: URL: https://github.com/apache/hadoop/pull/6295#issuecomment-1828032916 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18924) upgrade grpc jars to v1.53.0 due to CVEs

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790120#comment-17790120 ] ASF GitHub Bot commented on HADOOP-18924: - ayushtkn commented on code in PR #61

Re: [PR] HADOOP-18924. upgrade to grpc 1.53.0 due to CVEs [hadoop]

2023-11-27 Thread via GitHub
ayushtkn commented on code in PR #6161: URL: https://github.com/apache/hadoop/pull/6161#discussion_r1406306835 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-csi/pom.xml: ## @@ -26,7 +26,8 @@ jar -1.26.0 +1.53.0 +1.21 Review Comment: this

Re: [PR] Improve description for security mailing lists. [hadoop-site]

2023-11-27 Thread via GitHub
ayushtkn merged PR #48: URL: https://github.com/apache/hadoop-site/pull/48 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

[jira] [Commented] (HADOOP-18967) Allow no-downtime migration of HDFS clusters into secure mode

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790108#comment-17790108 ] ASF GitHub Bot commented on HADOOP-18967: - charlesconnell commented on PR #6293

Re: [PR] YARN-11611. Remove json-io to 4.14.1 due to CVE-2023-34610 [hadoop]

2023-11-27 Thread via GitHub
brumi1024 merged PR #6257: URL: https://github.com/apache/hadoop/pull/6257 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

Re: [PR] HADOOP-18967 Allow no-downtime migration of HDFS clusters into secure mode [hadoop]

2023-11-27 Thread via GitHub
charlesconnell commented on PR #6293: URL: https://github.com/apache/hadoop/pull/6293#issuecomment-1827965345 @Hexiaoqiao Thanks for having a looking. This PR should only impact HDFS. There are changes in the IPC layer code, but I do not expect this will impact other components in practice.

Re: [PR] YARN-11611. Remove json-io to 4.14.1 due to CVE-2023-34610 [hadoop]

2023-11-27 Thread via GitHub
brumi1024 commented on PR #6257: URL: https://github.com/apache/hadoop/pull/6257#issuecomment-1827964060 Thanks @tomicooler for the review. Merged to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HADOOP-18967) Allow no-downtime migration of HDFS clusters into secure mode

2023-11-27 Thread Charles Connell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Connell updated HADOOP-18967: - Description: My employer (HubSpot) recently completed transitioning all of the Hadoop

Re: [PR] YARN-11561. [Federation] GPG Supports Format PolicyStateStore. [hadoop]

2023-11-27 Thread via GitHub
slfan1989 commented on PR #6300: URL: https://github.com/apache/hadoop/pull/6300#issuecomment-1827959074 @goiri Can you help review this PR? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HADOOP-18967) Allow no-downtime migration of HDFS clusters into secure mode

2023-11-27 Thread Charles Connell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Connell updated HADOOP-18967: - Summary: Allow no-downtime migration of HDFS clusters into secure mode (was: Allow sec

Re: [PR] YARN-11613. [Federation] Router CLI Supports Delete SubClusterPolicyConfiguration Of Queues. [hadoop]

2023-11-27 Thread via GitHub
slfan1989 commented on PR #6295: URL: https://github.com/apache/hadoop/pull/6295#issuecomment-1827957387 > Fix unit test. @goiri Thank you very much for your help in reviewing the code! I will fix it. -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] Improve description for security mailing lists. [hadoop-site]

2023-11-27 Thread via GitHub
raboof commented on code in PR #48: URL: https://github.com/apache/hadoop-site/pull/48#discussion_r1406248387 ## content/mailing_lists.html: ## @@ -184,6 +184,14 @@ Security In order to post to the list, it is NOT necessary to first subscribe to it. For information on publis

Re: [PR] Improve description for security mailing lists. [hadoop-site]

2023-11-27 Thread via GitHub
ayushtkn commented on PR #48: URL: https://github.com/apache/hadoop-site/pull/48#issuecomment-1827940866 https://github.com/apache/hadoop-site/assets/25608848/3e8fd6ac-fd6e-4b1d-ad55-0c73a1bd7e4a";> Done, @raboof can you check once more -- This is an automated message from t

Re: [PR] HDFS-17263. RBF: Fix client ls trash path cannot get except default nameservices trash path [hadoop]

2023-11-27 Thread via GitHub
Hexiaoqiao commented on code in PR #6291: URL: https://github.com/apache/hadoop/pull/6291#discussion_r1406206626 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/router/TestRouterTrash.java: ## @@ -227,6 +234,61 @@ public void testMov

[jira] [Commented] (HADOOP-18967) Allow secure mode to be enabled with no downtime

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790086#comment-17790086 ] ASF GitHub Bot commented on HADOOP-18967: - Hexiaoqiao commented on PR #6293: UR

Re: [PR] HADOOP-18967 Allow no-downtime migration into secure mode [hadoop]

2023-11-27 Thread via GitHub
Hexiaoqiao commented on PR #6293: URL: https://github.com/apache/hadoop/pull/6293#issuecomment-1827864128 @charlesconnell Thanks for your great work here. I am sure it will be helpful for some end users migrate to secure mode cluster. Not review carefully, one concerns, just notice that the

Re: [PR] Use thread pool to improve the speed of creating control files in TestDFSIO [hadoop]

2023-11-27 Thread via GitHub
Hexiaoqiao commented on PR #6294: URL: https://github.com/apache/hadoop/pull/6294#issuecomment-1827841032 Hi @hfutatzhanghb Thanks for your contribution. Please create JIRA first, then add the JIRA-ID to the title as usual. Thanks. -- This is an automated message from the Apache Git Serv

[PR] YARN-11561. [Federation] GPG Supports Format PolicyStateStore. [hadoop]

2023-11-27 Thread via GitHub
slfan1989 opened a new pull request, #6300: URL: https://github.com/apache/hadoop/pull/6300 ### Description of PR JIRA: YARN-11561. [Federation] GPG Supports Format PolicyStateStore. ### How was this patch tested? Add Junit Test. ### For code changes:

Re: [PR] HDFS-17223. Add journalnode maintenance node list [hadoop]

2023-11-27 Thread via GitHub
Hexiaoqiao commented on PR #6183: URL: https://github.com/apache/hadoop/pull/6183#issuecomment-1827820008 Thanks @gp1314 and @xinglin for your works. I am not very sure to get the total purpose here. > In the case of configuring 3 journal nodes in HDFS, if only 2 journal nodes are av

[jira] [Commented] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790067#comment-17790067 ] ASF GitHub Bot commented on HADOOP-18915: - steveloughran commented on code in P

Re: [PR] HADOOP-18915. Tune S3A http connection settings [hadoop]

2023-11-27 Thread via GitHub
steveloughran commented on code in PR #6180: URL: https://github.com/apache/hadoop/pull/6180#discussion_r1406107931 ## hadoop-common-project/hadoop-common/src/main/resources/core-default.xml: ## @@ -1596,14 +1596,15 @@ fs.s3a.connection.establish.timeout - 5000 - Socket

[jira] [Created] (HADOOP-18992) SingleCluster.html instructions are ordered incorrectly

2023-11-27 Thread Istvan Toth (Jira)
Istvan Toth created HADOOP-18992: Summary: SingleCluster.html instructions are ordered incorrectly Key: HADOOP-18992 URL: https://issues.apache.org/jira/browse/HADOOP-18992 Project: Hadoop Common

Re: [PR] Improve description for security mailing lists. [hadoop-site]

2023-11-27 Thread via GitHub
raboof commented on code in PR #48: URL: https://github.com/apache/hadoop-site/pull/48#discussion_r1405831493 ## content/mailing_lists.html: ## @@ -184,6 +184,13 @@ Security In order to post to the list, it is NOT necessary to first subscribe to it. For information on publis

[jira] [Commented] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3

2023-11-27 Thread Istvan Toth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790002#comment-17790002 ] Istvan Toth commented on HADOOP-18991: -- This issues is discussed in HADOOP-16542 .

[jira] [Commented] (HADOOP-18277) Remove org.apache.hadoop.test#Whitebox Class

2023-11-27 Thread Istvan Toth (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1778#comment-1778 ] Istvan Toth commented on HADOOP-18277: -- IMO it would be prefereable not not to use

[jira] [Created] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3

2023-11-27 Thread Istvan Toth (Jira)
Istvan Toth created HADOOP-18991: Summary: Remove commons-benautils dependency from Hadoop 3 Key: HADOOP-18991 URL: https://issues.apache.org/jira/browse/HADOOP-18991 Project: Hadoop Common I

Re: [PR] HDFS-17263. RBF: Fix client ls trash path cannot get except default nameservices trash path [hadoop]

2023-11-27 Thread via GitHub
slfan1989 commented on code in PR #6291: URL: https://github.com/apache/hadoop/pull/6291#discussion_r1405853588 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/resolver/MountTableResolver.java: ## @@ -357,7 +357,7 @@ public void refr

Re: [PR] YARN-11614. Fix a flaky test [hadoop]

2023-11-27 Thread via GitHub
slfan1989 commented on PR #6299: URL: https://github.com/apache/hadoop/pull/6299#issuecomment-1827431274 @Carol7102 We can use the link below and choose create issue. https://issues.apache.org/jira/projects/YARN/issues/YARN-11560?filter=allopenissues https://github.com/apache/h

Re: [PR] YARN-11614. Fix a flaky test [hadoop]

2023-11-27 Thread via GitHub
hadoop-yetus commented on PR #6299: URL: https://github.com/apache/hadoop/pull/6299#issuecomment-1827401010 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex