[GitHub] [hadoop] rdingankar opened a new pull request, #5556: HDFS-16982 Use the right Quantiles Array for Inverse Quantiles snapshot

2023-04-13 Thread via GitHub
rdingankar opened a new pull request, #5556: URL: https://github.com/apache/hadoop/pull/5556 ### Description of PR [HDFS-16949](https://issues.apache.org/jira/browse/HDFS-16949) introduced InverseQuantiles. However during snapshot for Inverse Quantiles we were still trying to

[GitHub] [hadoop] hadoop-yetus commented on pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5554: URL: https://github.com/apache/hadoop/pull/5554#issuecomment-1507950241 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
virajjasani commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1166242347 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -461,6 +462,14 @@ private void

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
virajjasani commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1166242347 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -461,6 +462,14 @@ private void

[GitHub] [hadoop] lgh-cn commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
lgh-cn commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1166235559 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -202,6 +202,7 @@ import

[GitHub] [hadoop] lgh-cn commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
lgh-cn commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1166234652 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -461,6 +462,14 @@ private void

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5541: HDFS-16974. Consider volumes average load of each DataNode when choosing target.

2023-04-13 Thread via GitHub
Hexiaoqiao commented on PR #5541: URL: https://github.com/apache/hadoop/pull/5541#issuecomment-1507845492 Committed to trunk. Thanks @zhangshuyan0 for your contributions! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] Hexiaoqiao merged pull request #5541: HDFS-16974. Consider volumes average load of each DataNode when choosing target.

2023-04-13 Thread via GitHub
Hexiaoqiao merged PR #5541: URL: https://github.com/apache/hadoop/pull/5541 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] lgh-cn commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
lgh-cn commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1166211712 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -461,6 +462,14 @@ private void

[GitHub] [hadoop] hadoop-yetus commented on pull request #5532: HDFS-16972. Delete a snapshot may deleteCurrentFile.

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5532: URL: https://github.com/apache/hadoop/pull/5532#issuecomment-1507781141 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712135#comment-17712135 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5554: URL: https://github.com/apache/hadoop/pull/5554#issuecomment-1507770060 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507769988 Thank you, @ayushtkn and @cnauroth ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-17834) Bump aliyun-sdk-oss to 3.13.0

2023-04-13 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712131#comment-17712131 ] Siyao Meng commented on HADOOP-17834: - transitive dep licenses were an oversight. Thanks

[GitHub] [hadoop] hadoop-yetus commented on pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5554: URL: https://github.com/apache/hadoop/pull/5554#issuecomment-1507757696 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712128#comment-17712128 ] ASF GitHub Bot commented on HADOOP-18671: - hadoop-yetus commented on PR #5553: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5553: HADOOP-18671 Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5553: URL: https://github.com/apache/hadoop/pull/5553#issuecomment-1507741350 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] cnauroth commented on a diff in pull request #5520: HDFS-16965. Add switch to decide whether to enable native codec.

2023-04-13 Thread via GitHub
cnauroth commented on code in PR #5520: URL: https://github.com/apache/hadoop/pull/5520#discussion_r1166128382 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/CodecUtil.java: ## @@ -170,8 +174,14 @@ private static String[] getRawCoderNames(

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712116#comment-17712116 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507685483 Got it. Thank you for the pointers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712114#comment-17712114 ] ASF GitHub Bot commented on HADOOP-18590: - ayushtkn commented on PR #: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
ayushtkn commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507680860 We have one here: https://ci-hadoop.apache.org/view/Hadoop/job/Hadoop-trunk-Commit/ I can add -Pdist here if you say, but we don't check the results of this build :) We

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712113#comment-17712113 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507679802 Also, cc @sunchao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HADOOP-18691) Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712108#comment-17712108 ] ASF GitHub Bot commented on HADOOP-18691: - hadoop-yetus commented on PR #5540: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5540: HADOOP-18691. Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5540: URL: https://github.com/apache/hadoop/pull/5540#issuecomment-1507658012 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712105#comment-17712105 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507655963 BTW, do we have a regular SNAPSHOT publishing job? Apache ORC and Apache Spark has a daily SNAPSHOT publishing jobs and SBOM is tested there independently. -- This is an

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712102#comment-17712102 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507655368 Ya, I agree with your decision, @ayushtkn . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712094#comment-17712094 ] ASF GitHub Bot commented on HADOOP-18590: - ayushtkn commented on PR #: URL:

[GitHub] [hadoop] ayushtkn commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
ayushtkn commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507638386 Thanx, We don't have a regular test with -Pdist, I thought this was required only during release time, we moved this to -Pdist in hive as well, recently in favour of saving time during

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712086#comment-17712086 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507621733 Anyway, I moved it to under `dist` profile according to your advice, @ayushtkn . -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712081#comment-17712081 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507606680 Do you have a regular test pipeline with `-Pdist`, @ayushtkn ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (HADOOP-18207) Introduce hadoop-logging module

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712077#comment-17712077 ] ASF GitHub Bot commented on HADOOP-18207: - hadoop-yetus commented on PR #5503: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5503: HADOOP-18207. Introduce hadoop-logging module

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5503: URL: https://github.com/apache/hadoop/pull/5503#issuecomment-1507593667 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712071#comment-17712071 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun commented on PR #: URL:

[GitHub] [hadoop] dongjoon-hyun commented on pull request #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun commented on PR #: URL: https://github.com/apache/hadoop/pull/#issuecomment-1507588959 cc @steveloughran -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Commented] (HADOOP-18697) transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile

2023-04-13 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712069#comment-17712069 ] Viraj Jasani commented on HADOOP-18697: --- Came across this one time but was never able to

[jira] [Commented] (HADOOP-18590) Publish SBOM artifacts

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712068#comment-17712068 ] ASF GitHub Bot commented on HADOOP-18590: - dongjoon-hyun opened a new pull request, #: URL:

[GitHub] [hadoop] dongjoon-hyun opened a new pull request, #5555: HADOOP-18590. Publish SBOM artifacts

2023-04-13 Thread via GitHub
dongjoon-hyun opened a new pull request, #: URL: https://github.com/apache/hadoop/pull/ ### Description of PR This is a second try of #5281 with new `cyclonedx` plugin `2.7.6`. This PR aims to publish SBOM artifacts. -

[GitHub] [hadoop] hadoop-yetus commented on pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5552: URL: https://github.com/apache/hadoop/pull/5552#issuecomment-1507583774 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Updated] (HADOOP-18702) Remove ozone mailing lists from Hadoop website

2023-04-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-18702: - Summary: Remove ozone mailing lists from Hadoop website (was: Remove ozone mailing

[GitHub] [hadoop] hadoop-yetus commented on pull request #5547: HDFS-16977. Forbid assigned characters in pathname.

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5547: URL: https://github.com/apache/hadoop/pull/5547#issuecomment-1507507256 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
ayushtkn commented on code in PR #5554: URL: https://github.com/apache/hadoop/pull/5554#discussion_r1165932788 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/tools/federation/RouterAdmin.java: ## @@ -140,7 +143,7 @@ private void printUsage(String

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
virajjasani commented on code in PR #5554: URL: https://github.com/apache/hadoop/pull/5554#discussion_r1165913930 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/tools/federation/RouterAdmin.java: ## @@ -140,7 +143,7 @@ private void printUsage(String

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
virajjasani commented on code in PR #5554: URL: https://github.com/apache/hadoop/pull/5554#discussion_r1165913930 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/tools/federation/RouterAdmin.java: ## @@ -140,7 +143,7 @@ private void printUsage(String

[GitHub] [hadoop] ayushtkn commented on a diff in pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
ayushtkn commented on code in PR #5554: URL: https://github.com/apache/hadoop/pull/5554#discussion_r1165906468 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/tools/federation/RouterAdmin.java: ## @@ -140,7 +143,7 @@ private void printUsage(String

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
virajjasani commented on code in PR #5554: URL: https://github.com/apache/hadoop/pull/5554#discussion_r1165897523 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/tools/federation/RouterAdmin.java: ## @@ -462,6 +481,111 @@ public int run(String[]

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
virajjasani commented on code in PR #5554: URL: https://github.com/apache/hadoop/pull/5554#discussion_r1165896153 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/store/protocol/AddAllMountTableEntryRequest.java: ## @@ -0,0 +1,51 @@

[GitHub] [hadoop] goiri commented on a diff in pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
goiri commented on code in PR #5554: URL: https://github.com/apache/hadoop/pull/5554#discussion_r1165888263 ## hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/store/protocol/AddAllMountTableEntryRequest.java: ## @@ -0,0 +1,51 @@ +/* +

[jira] [Assigned] (HADOOP-18702) Remove ozone mailing list from Hadoop website

2023-04-13 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HADOOP-18702: Assignee: Wei-Chiu Chuang > Remove ozone mailing list from Hadoop website >

[jira] [Created] (HADOOP-18702) Remove ozone mailing list from Hadoop website

2023-04-13 Thread Wei-Chiu Chuang (Jira)
Wei-Chiu Chuang created HADOOP-18702: Summary: Remove ozone mailing list from Hadoop website Key: HADOOP-18702 URL: https://issues.apache.org/jira/browse/HADOOP-18702 Project: Hadoop Common

[GitHub] [hadoop] hadoop-yetus commented on pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5554: URL: https://github.com/apache/hadoop/pull/5554#issuecomment-1507414923 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] virajjasani commented on pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
virajjasani commented on PR #5552: URL: https://github.com/apache/hadoop/pull/5552#issuecomment-1507395844 IMHO we could do something like this: add a new key/value pair in the CallerContext at RouterRpcClient level, e.g. `append("isRouter", "true")` and then at audit log level, instead of

[jira] [Commented] (HADOOP-18691) Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712003#comment-17712003 ] ASF GitHub Bot commented on HADOOP-18691: - xBis7 commented on PR #5540: URL:

[GitHub] [hadoop] xBis7 commented on pull request #5540: HADOOP-18691. Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread via GitHub
xBis7 commented on PR #5540: URL: https://github.com/apache/hadoop/pull/5540#issuecomment-1507386579 @smengcl Thanks for looking into this PR. I've addressed your comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (HADOOP-18691) Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712002#comment-17712002 ] ASF GitHub Bot commented on HADOOP-18691: - xBis7 commented on code in PR #5540: URL:

[GitHub] [hadoop] xBis7 commented on a diff in pull request #5540: HADOOP-18691. Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread via GitHub
xBis7 commented on code in PR #5540: URL: https://github.com/apache/hadoop/pull/5540#discussion_r1165856406 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Schedulable.java: ## @@ -29,5 +29,9 @@ public interface Schedulable { public

[GitHub] [hadoop] virajjasani commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
virajjasani commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1165847902 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -461,6 +462,14 @@ private void

[jira] [Commented] (HADOOP-18693) Upgrade Apache Derby due to CVEs

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711991#comment-17711991 ] ASF GitHub Bot commented on HADOOP-18693: - smengcl merged PR #5427: URL:

[jira] [Updated] (HADOOP-18693) Upgrade Apache Derby from 10.10.2.0 to 10.14.2.0 due to CVEs

2023-04-13 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-18693: Summary: Upgrade Apache Derby from 10.10.2.0 to 10.14.2.0 due to CVEs (was: Upgrade Apache

[jira] [Resolved] (HADOOP-18693) Upgrade Apache Derby due to CVEs

2023-04-13 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng resolved HADOOP-18693. - Fix Version/s: 3.4.0 Resolution: Fixed > Upgrade Apache Derby due to CVEs >

[GitHub] [hadoop] smengcl merged pull request #5427: HADOOP-18693. Bump derby from 10.10.2.0 to 10.14.2.0 in /hadoop-project

2023-04-13 Thread via GitHub
smengcl merged PR #5427: URL: https://github.com/apache/hadoop/pull/5427 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-18693) Upgrade Apache Derby due to CVEs

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18693: Labels: pull-request-available (was: ) > Upgrade Apache Derby due to CVEs >

[jira] [Commented] (HADOOP-18693) Upgrade Apache Derby due to CVEs

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711989#comment-17711989 ] ASF GitHub Bot commented on HADOOP-18693: - smengcl commented on PR #5427: URL:

[GitHub] [hadoop] smengcl commented on pull request #5427: HADOOP-18693. Bump derby from 10.10.2.0 to 10.14.2.0 in /hadoop-project

2023-04-13 Thread via GitHub
smengcl commented on PR #5427: URL: https://github.com/apache/hadoop/pull/5427#issuecomment-1507338590 Thanks @steveloughran . CI looks good. This has some CVE fixes. I will merge in a minute. -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Updated] (HADOOP-18693) Upgrade Apache Derby due to CVEs

2023-04-13 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HADOOP-18693: Summary: Upgrade Apache Derby due to CVEs (was: upgrade Apache Derby due to CVEs) > Upgrade

[jira] [Commented] (HADOOP-18691) Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711986#comment-17711986 ] ASF GitHub Bot commented on HADOOP-18691: - smengcl commented on PR #5540: URL:

[GitHub] [hadoop] smengcl commented on pull request #5540: HADOOP-18691. Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread via GitHub
smengcl commented on PR #5540: URL: https://github.com/apache/hadoop/pull/5540#issuecomment-1507325267 Thanks @xBis7 . lgtm apart from one comment above. I'd like to invite @steveloughran to vet the interface method addition here as well. -- This is an automated message from the

[jira] [Commented] (HADOOP-18691) Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711978#comment-17711978 ] ASF GitHub Bot commented on HADOOP-18691: - smengcl commented on code in PR #5540: URL:

[GitHub] [hadoop] smengcl commented on a diff in pull request #5540: HADOOP-18691. Add a CallerContext getter on the Schedulable interface

2023-04-13 Thread via GitHub
smengcl commented on code in PR #5540: URL: https://github.com/apache/hadoop/pull/5540#discussion_r1165787297 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Schedulable.java: ## @@ -29,5 +29,9 @@ public interface Schedulable { public

[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests when disabled

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711974#comment-17711974 ] ASF GitHub Bot commented on HADOOP-18695: - hadoop-yetus commented on PR #5548: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5548: HADOOP-18695. S3A: reject multipart copy requests when disabled

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5548: URL: https://github.com/apache/hadoop/pull/5548#issuecomment-1507257856 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[GitHub] [hadoop] virajjasani commented on pull request #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
virajjasani commented on PR #5554: URL: https://github.com/apache/hadoop/pull/5554#issuecomment-1507238139 @goiri could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] virajjasani opened a new pull request, #5554: HDFS-16978. RBF: New Router admin command to support bulk add of mount points

2023-04-13 Thread via GitHub
virajjasani opened a new pull request, #5554: URL: https://github.com/apache/hadoop/pull/5554 All state store implementations support adding multiple state store records using single putAll() implementation. We should provide new router admin API to support bulk addition of mount table

[GitHub] [hadoop] slfan1989 commented on pull request #5127: YARN-11239. Optimize FederationClientInterceptor audit log.

2023-04-13 Thread via GitHub
slfan1989 commented on PR #5127: URL: https://github.com/apache/hadoop/pull/5127#issuecomment-1507227683 @goiri Can you help to merge this pr into the trunk branch? Thank you very much for your help, We have completed all methods of `clientrm#FederationClientInterceptor`. YARN-11239 is

[GitHub] [hadoop] goiri commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
goiri commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1165749819 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -202,6 +202,7 @@ import

[GitHub] [hadoop] goiri merged pull request #5536: [HDFS-16971] Add read metrics for remote reads in FileSystem Statistics #5534

2023-04-13 Thread via GitHub
goiri merged PR #5536: URL: https://github.com/apache/hadoop/pull/5536 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] goiri commented on a diff in pull request #5552: HDFS-16979. RBF: Add dfsrouter port in hdfsauditlog

2023-04-13 Thread via GitHub
goiri commented on code in PR #5552: URL: https://github.com/apache/hadoop/pull/5552#discussion_r1165751071 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java: ## @@ -461,6 +462,14 @@ private void

[jira] [Updated] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18671: Labels: pull-request-available (was: ) > Add recoverLease(), setSafeMode(),

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711944#comment-17711944 ] ASF GitHub Bot commented on HADOOP-18671: - taklwu opened a new pull request, #5553: URL:

[GitHub] [hadoop] taklwu opened a new pull request, #5553: HADOOP-18671 Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-04-13 Thread via GitHub
taklwu opened a new pull request, #5553: URL: https://github.com/apache/hadoop/pull/5553 ### Description of PR Propagating the recoverLease, setSafeMode, isFileClosed functions to separate interface as well as introducing new path capabilities ### How was this patch tested? 1.

[jira] [Updated] (HADOOP-18695) S3A: reject multipart copy requests when disabled

2023-04-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Summary: S3A: reject multipart copy requests when disabled (was: S3A: reject multipart

[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711936#comment-17711936 ] ASF GitHub Bot commented on HADOOP-18695: - steveloughran commented on PR #5548: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5548: HADOOP-18695. S3A: reject multipart copy requests initiated by tranfser manager when disabled

2023-04-13 Thread via GitHub
steveloughran commented on PR #5548: URL: https://github.com/apache/hadoop/pull/5548#issuecomment-1507133395 should be ready for review now. @dannycjones @mehakmeet @mukund-thakur @HarshitGupta11 note: this is not for use against aws S3, it would only make upload speed worse.

[jira] [Commented] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711934#comment-17711934 ] ASF GitHub Bot commented on HADOOP-18695: - steveloughran commented on PR #5548: URL:

[GitHub] [hadoop] steveloughran commented on pull request #5548: HADOOP-18695. S3A: reject multipart copy requests initiated by tranfser manager when disabled

2023-04-13 Thread via GitHub
steveloughran commented on PR #5548: URL: https://github.com/apache/hadoop/pull/5548#issuecomment-1507128802 tested s3 london; no errors other than the unrelated `ITestS3ABucketExistence` failures -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] hadoop-yetus commented on pull request #5550: YARN-11465. Improved YarnClient Log Format

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5550: URL: https://github.com/apache/hadoop/pull/5550#issuecomment-1507071592 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18687) Remove unnecessary dependency on json-smart

2023-04-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711908#comment-17711908 ] ASF GitHub Bot commented on HADOOP-18687: - hadoop-yetus commented on PR #5549: URL:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5549: HADOOP-18687: remove json-smart dependency

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5549: URL: https://github.com/apache/hadoop/pull/5549#issuecomment-1507037769 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18422) TestServiceInterruptHandling.testRegisterAndRaise failing intermittently

2023-04-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711889#comment-17711889 ] Steve Loughran commented on HADOOP-18422: - seen this. probably a race condition, those sleep

[jira] [Commented] (HADOOP-18701) Generic Build Improvements

2023-04-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711884#comment-17711884 ] Steve Loughran commented on HADOOP-18701: - also make sure that surefire prints the full stack

[GitHub] [hadoop] lgh-cn opened a new pull request, #5552: add dfsrouter port in hdfsauditlog when remote client port is record …

2023-04-13 Thread via GitHub
lgh-cn opened a new pull request, #5552: URL: https://github.com/apache/hadoop/pull/5552 …by routerrpcclient ### Description of PR when remote client request through dfsrouter to namenode, the hdfsauditlog record the remote client ip and port (HDFS-13248),dfsrouter IP,but

[GitHub] [hadoop] luomh1998 commented on pull request #5526: HDFS-16970. EC: client copy wrong buffer from decode output during pread

2023-04-13 Thread via GitHub
luomh1998 commented on PR #5526: URL: https://github.com/apache/hadoop/pull/5526#issuecomment-1506868543 @tasanuma please review for this pr, it's a critical bug can cause wrong data when do preads. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] lgh-cn closed pull request #5544: hdfs auditlog add remote port info

2023-04-13 Thread via GitHub
lgh-cn closed pull request #5544: hdfs auditlog add remote port info URL: https://github.com/apache/hadoop/pull/5544 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hadoop] lgh-cn commented on pull request #5544: hdfs auditlog add remote port info

2023-04-13 Thread via GitHub
lgh-cn commented on PR #5544: URL: https://github.com/apache/hadoop/pull/5544#issuecomment-1506692394 This is already done with HDFS-16266 HDFS-16310 HDFS-13248 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] hadoop-yetus commented on pull request #5551: YARN-11378. [Federation] Support checkForDecommissioningNodes、refreshClusterMaxPriority API's for Federation.

2023-04-13 Thread via GitHub
hadoop-yetus commented on PR #5551: URL: https://github.com/apache/hadoop/pull/5551#issuecomment-1506668593 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

  1   2   >