[GitHub] [hadoop] hadoop-yetus commented on pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5364: URL: https://github.com/apache/hadoop/pull/5364#issuecomment-1480682835 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-17358) Improve excessive reloading of Configurations

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703889#comment-17703889 ] ASF GitHub Bot commented on HADOOP-17358: - hadoop-yetus commented on PR #5504:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5504: HADOOP-17358

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5504: URL: https://github.com/apache/hadoop/pull/5504#issuecomment-1480627385 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-17358) Improve excessive reloading of Configurations

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703886#comment-17703886 ] ASF GitHub Bot commented on HADOOP-17358: - OpsHubTech closed pull request #5504

[jira] [Commented] (HADOOP-17358) Improve excessive reloading of Configurations

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703885#comment-17703885 ] ASF GitHub Bot commented on HADOOP-17358: - OpsHubTech opened a new pull request

[GitHub] [hadoop] OpsHubTech closed pull request #5504: HADOOP-17358

2023-03-22 Thread via GitHub
OpsHubTech closed pull request #5504: HADOOP-17358 URL: https://github.com/apache/hadoop/pull/5504 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commo

[GitHub] [hadoop] OpsHubTech opened a new pull request, #5504: HADOOP-17358

2023-03-22 Thread via GitHub
OpsHubTech opened a new pull request, #5504: URL: https://github.com/apache/hadoop/pull/5504 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADO

[jira] [Commented] (HADOOP-18458) AliyunOSS: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703869#comment-17703869 ] ASF GitHub Bot commented on HADOOP-18458: - ChenSammi commented on code in PR #4

[GitHub] [hadoop] ChenSammi commented on a diff in pull request #4912: HADOOP-18458: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread via GitHub
ChenSammi commented on code in PR #4912: URL: https://github.com/apache/hadoop/pull/4912#discussion_r1145662429 ## hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSBlockOutputStream.java: ## @@ -49,71 +48,103 @@ public class AliyunOSSBlockOutputS

[jira] [Commented] (HADOOP-18458) AliyunOSS: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703868#comment-17703868 ] ASF GitHub Bot commented on HADOOP-18458: - ChenSammi commented on code in PR #4

[GitHub] [hadoop] ChenSammi commented on a diff in pull request #4912: HADOOP-18458: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread via GitHub
ChenSammi commented on code in PR #4912: URL: https://github.com/apache/hadoop/pull/4912#discussion_r1145662429 ## hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSBlockOutputStream.java: ## @@ -49,71 +48,103 @@ public class AliyunOSSBlockOutputS

[jira] [Commented] (HADOOP-18458) AliyunOSS: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703864#comment-17703864 ] ASF GitHub Bot commented on HADOOP-18458: - ChenSammi commented on code in PR #4

[GitHub] [hadoop] ChenSammi commented on a diff in pull request #4912: HADOOP-18458: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread via GitHub
ChenSammi commented on code in PR #4912: URL: https://github.com/apache/hadoop/pull/4912#discussion_r1145661765 ## hadoop-tools/hadoop-aliyun/src/site/markdown/tools/hadoop-aliyun/index.md: ## @@ -251,9 +251,52 @@ please raise your issues with them. + +

[jira] [Commented] (HADOOP-18207) Introduce hadoop-logging module for log4j usage

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703860#comment-17703860 ] ASF GitHub Bot commented on HADOOP-18207: - virajjasani opened a new pull reques

[jira] [Updated] (HADOOP-18207) Introduce hadoop-logging module for log4j usage

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18207: Labels: pull-request-available (was: ) > Introduce hadoop-logging module for log4j usage

[GitHub] [hadoop] virajjasani opened a new pull request, #5503: HADOOP-18207. Introduce hadoop-logging module for log4j usage

2023-03-22 Thread via GitHub
virajjasani opened a new pull request, #5503: URL: https://github.com/apache/hadoop/pull/5503 Goals: 1. Provide the ability to change log level, get log level, etc. 2. Place all the appender implementation. 3. Hide the real logging implementation. 4. Later we could remove all

[jira] [Updated] (HADOOP-18207) Introduce hadoop-logging module for log4j usage

2023-03-22 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18207: -- Description: There are several goals here: # Provide the ability to change log level, get lo

[jira] [Updated] (HADOOP-18207) Introduce hadoop-logging module for log4j usage

2023-03-22 Thread Viraj Jasani (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-18207: -- Summary: Introduce hadoop-logging module for log4j usage (was: Introduce a hadoop-logging mo

[jira] [Resolved] (HADOOP-18644) Add bswap support for LoongArch

2023-03-22 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HADOOP-18644. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Add bswap support

[jira] [Commented] (HADOOP-18644) Add bswap support for LoongArch

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703847#comment-17703847 ] ASF GitHub Bot commented on HADOOP-18644: - Hexiaoqiao commented on PR #5453: UR

[GitHub] [hadoop] Hexiaoqiao commented on pull request #5453: HADOOP-18644. Add bswap support for LoongArch

2023-03-22 Thread via GitHub
Hexiaoqiao commented on PR #5453: URL: https://github.com/apache/hadoop/pull/5453#issuecomment-1480542091 Committed to trunk considering this is compatible changes. Thanks @zhaixiaojuan for your contribution. -- This is an automated message from the Apache Git Service. To respond to the m

[jira] [Commented] (HADOOP-18644) Add bswap support for LoongArch

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703846#comment-17703846 ] ASF GitHub Bot commented on HADOOP-18644: - Hexiaoqiao merged PR #5453: URL: htt

[GitHub] [hadoop] Hexiaoqiao merged pull request #5453: HADOOP-18644. Add bswap support for LoongArch

2023-03-22 Thread via GitHub
Hexiaoqiao merged PR #5453: URL: https://github.com/apache/hadoop/pull/5453 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@ha

[jira] [Resolved] (HADOOP-18662) ListFiles with recursive fails with FNF

2023-03-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-18662. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > ListFiles with

[jira] [Commented] (HADOOP-18662) ListFiles with recursive fails with FNF

2023-03-22 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703842#comment-17703842 ] Ayush Saxena commented on HADOOP-18662: --- Committed to trunk. Thanx [~ste...@apach

[jira] [Commented] (HADOOP-18662) ListFiles with recursive fails with FNF

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703841#comment-17703841 ] ASF GitHub Bot commented on HADOOP-18662: - ayushtkn merged PR #5477: URL: https

[GitHub] [hadoop] ayushtkn merged pull request #5477: HADOOP-18662. ListFiles with recursive fails with FNF.

2023-03-22 Thread via GitHub
ayushtkn merged PR #5477: URL: https://github.com/apache/hadoop/pull/5477 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

[GitHub] [hadoop] ZanderXu closed pull request #5501: HDFS-16962. The blockReport RPC should not update the lastBlockReportTime if this blockReport is ignored

2023-03-22 Thread via GitHub
ZanderXu closed pull request #5501: HDFS-16962. The blockReport RPC should not update the lastBlockReportTime if this blockReport is ignored URL: https://github.com/apache/hadoop/pull/5501 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (HADOOP-18662) ListFiles with recursive fails with FNF

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703820#comment-17703820 ] ASF GitHub Bot commented on HADOOP-18662: - hadoop-yetus commented on PR #5477:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5477: HADOOP-18662. ListFiles with recursive fails with FNF.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5477: URL: https://github.com/apache/hadoop/pull/5477#issuecomment-1480440185 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5502: Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5502: URL: https://github.com/apache/hadoop/pull/5502#issuecomment-1480361462 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5364: URL: https://github.com/apache/hadoop/pull/5364#issuecomment-1480348050 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5364: URL: https://github.com/apache/hadoop/pull/5364#issuecomment-1480333212 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] dependabot[bot] opened a new pull request, #5502: Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-03-22 Thread via GitHub
dependabot[bot] opened a new pull request, #5502: URL: https://github.com/apache/hadoop/pull/5502 Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.3 to 1.5.4. Release notes Sourced from https://github.com/jettison-json/jettison/releases";>jettison's releases.

[GitHub] [hadoop] sadanand48 commented on a diff in pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-22 Thread via GitHub
sadanand48 commented on code in PR #5364: URL: https://github.com/apache/hadoop/pull/5364#discussion_r1145258696 ## hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpSync.java: ## @@ -1276,4 +1283,63 @@ private void snapshotDiffWithPaths(Path sourceFSPat

[GitHub] [hadoop] sadanand48 commented on a diff in pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-22 Thread via GitHub
sadanand48 commented on code in PR #5364: URL: https://github.com/apache/hadoop/pull/5364#discussion_r1145254871 ## hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestDistCpSync.java: ## @@ -1305,7 +1305,7 @@ public void testSyncSnapshotDiffWithDummyFileSystem(

[GitHub] [hadoop] sadanand48 commented on a diff in pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-22 Thread via GitHub
sadanand48 commented on code in PR #5364: URL: https://github.com/apache/hadoop/pull/5364#discussion_r1145254640 ## hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpSync.java: ## @@ -161,20 +161,32 @@ private void checkFilesystemSupport(Path sourceDir, Path

[jira] [Resolved] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2023-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18329. - Resolution: Fixed closing as done. if it doesn't work, then create a follow on jira fo

[jira] [Updated] (HADOOP-18590) Publish SBOM artifacts

2023-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18590: Fix Version/s: (was: 3.4.0) (was: 3.3.5) > Publish SBOM artifa

[jira] [Commented] (HADOOP-18565) AWS SDK V2 - Complete outstanding items

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703712#comment-17703712 ] ASF GitHub Bot commented on HADOOP-18565: - ahmarsuhail commented on code in PR

[GitHub] [hadoop] ahmarsuhail commented on a diff in pull request #5421: HADOOP-18565. Completes outstanding items for the SDK V2 upgrade.

2023-03-22 Thread via GitHub
ahmarsuhail commented on code in PR #5421: URL: https://github.com/apache/hadoop/pull/5421#discussion_r1144985927 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3ABucketExistence.java: ## @@ -124,30 +125,37 @@ private Configuration createConfigurationWit

[jira] [Commented] (HADOOP-18565) AWS SDK V2 - Complete outstanding items

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703711#comment-17703711 ] ASF GitHub Bot commented on HADOOP-18565: - ahmarsuhail commented on PR #5421: U

[GitHub] [hadoop] ahmarsuhail commented on pull request #5421: HADOOP-18565. Completes outstanding items for the SDK V2 upgrade.

2023-03-22 Thread via GitHub
ahmarsuhail commented on PR #5421: URL: https://github.com/apache/hadoop/pull/5421#issuecomment-1479763570 I have some concerns for about this region first approach for third party stores as well. The region probe is not going to work. I don't know how regions actually work for third party

[GitHub] [hadoop] hadoop-yetus commented on pull request #5477: HADOOP-18662. ListFiles with recursive fails with FNF.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5477: URL: https://github.com/apache/hadoop/pull/5477#issuecomment-1479738878 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18662) ListFiles with recursive fails with FNF

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703707#comment-17703707 ] ASF GitHub Bot commented on HADOOP-18662: - hadoop-yetus commented on PR #5477:

[jira] [Commented] (HADOOP-18565) AWS SDK V2 - Complete outstanding items

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703704#comment-17703704 ] ASF GitHub Bot commented on HADOOP-18565: - ahmarsuhail commented on code in PR

[GitHub] [hadoop] ahmarsuhail commented on a diff in pull request #5421: HADOOP-18565. Completes outstanding items for the SDK V2 upgrade.

2023-03-22 Thread via GitHub
ahmarsuhail commented on code in PR #5421: URL: https://github.com/apache/hadoop/pull/5421#discussion_r1144957314 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3ABucketExistence.java: ## @@ -124,30 +125,37 @@ private Configuration createConfigurationWit

[GitHub] [hadoop] hadoop-yetus commented on pull request #5420: YARN-11442. Refactor FederationInterceptorREST Code.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5420: URL: https://github.com/apache/hadoop/pull/5420#issuecomment-1479715073 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] slfan1989 commented on pull request #5476: YARN-11446. [Federation] Add updateSchedulerConfiguration, getSchedulerConfiguration REST APIs for Router.

2023-03-22 Thread via GitHub
slfan1989 commented on PR #5476: URL: https://github.com/apache/hadoop/pull/5476#issuecomment-1479713983 @goiri Can you help review this PR again? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [hadoop] slfan1989 commented on pull request #5476: YARN-11446. [Federation] Add updateSchedulerConfiguration, getSchedulerConfiguration REST APIs for Router.

2023-03-22 Thread via GitHub
slfan1989 commented on PR #5476: URL: https://github.com/apache/hadoop/pull/5476#issuecomment-1479712701 @goiri Can you help review this pr? Thank you very much! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703697#comment-17703697 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1479705770 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5364: HDFS-16911. Distcp with snapshot diff to support Ozone filesystem.

2023-03-22 Thread via GitHub
steveloughran commented on code in PR #5364: URL: https://github.com/apache/hadoop/pull/5364#discussion_r1144815944 ## hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpSync.java: ## @@ -161,20 +161,32 @@ private void checkFilesystemSupport(Path sourceDir, P

[jira] [Commented] (HADOOP-18565) AWS SDK V2 - Complete outstanding items

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703669#comment-17703669 ] ASF GitHub Bot commented on HADOOP-18565: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5421: HADOOP-18565. Completes outstanding items for the SDK V2 upgrade.

2023-03-22 Thread via GitHub
steveloughran commented on code in PR #5421: URL: https://github.com/apache/hadoop/pull/5421#discussion_r1144812071 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3ABucketExistence.java: ## @@ -124,30 +125,37 @@ private Configuration createConfigurationW

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703659#comment-17703659 ] ASF GitHub Bot commented on HADOOP-18012: - steveloughran commented on code in P

[GitHub] [hadoop] steveloughran commented on a diff in pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-22 Thread via GitHub
steveloughran commented on code in PR #5488: URL: https://github.com/apache/hadoop/pull/5488#discussion_r1144771186 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -519,11 +531,38 @@ public AbfsClientRenameResult renamePat

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703652#comment-17703652 ] ASF GitHub Bot commented on HADOOP-18012: - sreeb-msft commented on PR #5488: UR

[GitHub] [hadoop] sreeb-msft commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-22 Thread via GitHub
sreeb-msft commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1479533842 > commented. > > @sreeb-msft the changes in my patch are all on top of your commit #e8ce29ffce5 ; you should be able to cherry pick them from my branch directly onto your commit,

[GitHub] [hadoop] hadoop-yetus commented on pull request #5501: HDFS-16962. The blockReport RPC should not update the lastBlockReportTime if this blockReport is ignored

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5501: URL: https://github.com/apache/hadoop/pull/5501#issuecomment-1479460143 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18587) upgrade to jettison 1.5.3 to fix CVE-2022-40150

2023-03-22 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703580#comment-17703580 ] Andras Katona commented on HADOOP-18587: It's not enough just to upgrade the ve

[GitHub] [hadoop] hadoop-yetus commented on pull request #5501: HDFS-16962. The blockReport RPC should not update the lastBlockReportTime if this blockReport is ignored

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5501: URL: https://github.com/apache/hadoop/pull/5501#issuecomment-1479248303 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703571#comment-17703571 ] ASF GitHub Bot commented on HADOOP-18012: - hadoop-yetus commented on PR #5488:

[GitHub] [hadoop] hadoop-yetus commented on pull request #5488: HADOOP-18012. ABFS: Using Source Path eTags for Rename Idemptonency checks

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5488: URL: https://github.com/apache/hadoop/pull/5488#issuecomment-1479216642 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5500: HDFS-16961. The blockReport RPC should throw UnregisteredNodeException when the storedDN is null

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5500: URL: https://github.com/apache/hadoop/pull/5500#issuecomment-1479159931 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #5420: YARN-11442. Refactor FederationInterceptorREST Code.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5420: URL: https://github.com/apache/hadoop/pull/5420#issuecomment-1479098196 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5420: YARN-11442. Refactor FederationInterceptorREST Code.

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5420: URL: https://github.com/apache/hadoop/pull/5420#issuecomment-1479088306 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #5499: HDFS-16960. Remove useless getEditLog().logSync() for setTimes(), setPermission() and setQuota() PRC if there is no change

2023-03-22 Thread via GitHub
hadoop-yetus commented on PR #5499: URL: https://github.com/apache/hadoop/pull/5499#issuecomment-1479084948 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18458) AliyunOSS: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703519#comment-17703519 ] ASF GitHub Bot commented on HADOOP-18458: - wujinhu commented on code in PR #491

[jira] [Commented] (HADOOP-18458) AliyunOSS: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703520#comment-17703520 ] ASF GitHub Bot commented on HADOOP-18458: - wujinhu commented on code in PR #491

[GitHub] [hadoop] wujinhu commented on a diff in pull request #4912: HADOOP-18458: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread via GitHub
wujinhu commented on code in PR #4912: URL: https://github.com/apache/hadoop/pull/4912#discussion_r1144329309 ## hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSBlockOutputStream.java: ## @@ -138,64 +168,74 @@ public synchronized void write(int

[GitHub] [hadoop] wujinhu commented on a diff in pull request #4912: HADOOP-18458: AliyunOSSBlockOutputStream to support heap/off-heap buffer before uploading data to OSS

2023-03-22 Thread via GitHub
wujinhu commented on code in PR #4912: URL: https://github.com/apache/hadoop/pull/4912#discussion_r1144328831 ## hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AliyunOSSBlockOutputStream.java: ## @@ -49,71 +48,103 @@ public class AliyunOSSBlockOutputStr