[jira] [Commented] (HADOOP-19167) Change of Codec configuration does not work

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847156#comment-17847156 ] ASF GitHub Bot commented on HADOOP-19167: - skyskyhu commented on PR #6807: URL:

Re: [PR] HADOOP-19167 Bug Fix: Change of Codec configuration does not work [hadoop]

2024-05-16 Thread via GitHub
skyskyhu commented on PR #6807: URL: https://github.com/apache/hadoop/pull/6807#issuecomment-2116708164 Thanks to @ZanderXu for your kind help! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (HADOOP-19180) EC: Fix calculation errors caused by special index order

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847144#comment-17847144 ] ASF GitHub Bot commented on HADOOP-19180: - zhengchenyu commented on PR #6813: URL:

Re: [PR] HADOOP-19180. EC: Fix calculation errors caused by special index order [hadoop]

2024-05-16 Thread via GitHub
zhengchenyu commented on PR #6813: URL: https://github.com/apache/hadoop/pull/6813#issuecomment-2116592742 @haiyang1987 thank you for your reminder! I have move this to hadoop common! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Moved] (HADOOP-19180) EC: Fix calculation errors caused by special index order

2024-05-16 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng moved HDFS-17521 to HADOOP-19180: -- Key: HADOOP-19180 (was: HDFS-17521) Project: Hadoop Common

Re: [PR] HDFS-17521. EC: Fix calculation errors caused by special index order [hadoop]

2024-05-16 Thread via GitHub
haiyang1987 commented on PR #6813: URL: https://github.com/apache/hadoop/pull/6813#issuecomment-2116574613 > @ZanderXu Yes, I agree! This PR should be move to common. Should I create another HADOOP JIAR? At least I can't change HDFS jira to Hadoop jira. you can move hdfs to common

Re: [PR] HDFS-17521. Erasure Coding: Fix calculation errors caused by special index order [hadoop]

2024-05-16 Thread via GitHub
zhengchenyu commented on PR #6813: URL: https://github.com/apache/hadoop/pull/6813#issuecomment-2116531137 > Make sense. > > Maybe you should move this ticket to HADOOP and move the UT to common. @ZanderXu Yes, I agree! This PR should be move to common. Should I create another

Re: [PR] HDFS-17509. RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file. [hadoop]

2024-05-16 Thread via GitHub
ZanderXu commented on PR #6784: URL: https://github.com/apache/hadoop/pull/6784#issuecomment-2116524515 Merged. Thanks @LiuGuH for your contribution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HDFS-17509. RBF: Fix ClientProtocol.concat will throw NPE if tgr is a empty file. [hadoop]

2024-05-16 Thread via GitHub
ZanderXu merged PR #6784: URL: https://github.com/apache/hadoop/pull/6784 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (HADOOP-19167) Change of Codec configuration does not work

2024-05-16 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZanderXu resolved HADOOP-19167. --- Fix Version/s: 3.5.0 Resolution: Fixed > Change of Codec configuration does not work >

[jira] [Commented] (HADOOP-19167) Change of Codec configuration does not work

2024-05-16 Thread ZanderXu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847129#comment-17847129 ] ZanderXu commented on HADOOP-19167: --- [~skyskyhu] Sorry, I have no permission to set you as a

[jira] [Commented] (HADOOP-19167) Change of Codec configuration does not work

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847128#comment-17847128 ] ASF GitHub Bot commented on HADOOP-19167: - ZanderXu commented on PR #6807: URL:

[jira] [Commented] (HADOOP-19167) Change of Codec configuration does not work

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847127#comment-17847127 ] ASF GitHub Bot commented on HADOOP-19167: - ZanderXu merged PR #6807: URL:

Re: [PR] HADOOP-19167 Bug Fix: Change of Codec configuration does not work [hadoop]

2024-05-16 Thread via GitHub
ZanderXu commented on PR #6807: URL: https://github.com/apache/hadoop/pull/6807#issuecomment-2116517187 Merged. Thanks @skyskyhu for your contribution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HADOOP-19167 Bug Fix: Change of Codec configuration does not work [hadoop]

2024-05-16 Thread via GitHub
ZanderXu merged PR #6807: URL: https://github.com/apache/hadoop/pull/6807 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-19167) Change of Codec configuration does not work

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847121#comment-17847121 ] ASF GitHub Bot commented on HADOOP-19167: - skyskyhu commented on PR #6807: URL:

Re: [PR] HADOOP-19167 Bug Fix: Change of Codec configuration does not work [hadoop]

2024-05-16 Thread via GitHub
skyskyhu commented on PR #6807: URL: https://github.com/apache/hadoop/pull/6807#issuecomment-2116459318 @ZanderXu Could you help merge the commit when you have time? Thanks a lot -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[PR] Master [hadoop]

2024-05-16 Thread via GitHub
FarFlyField opened a new pull request, #6832: URL: https://github.com/apache/hadoop/pull/6832 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[PR] got the right version [hadoop]

2024-05-16 Thread via GitHub
FarFlyField opened a new pull request, #6831: URL: https://github.com/apache/hadoop/pull/6831 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[jira] [Commented] (HADOOP-18508) support multiple s3a integration test runs on same bucket in parallel

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847099#comment-17847099 ] ASF GitHub Bot commented on HADOOP-18508: - hadoop-yetus commented on PR #5081: URL:

Re: [PR] HADOOP-18508. S3A: Support parallel integration test runs on same bucket [hadoop]

2024-05-16 Thread via GitHub
hadoop-yetus commented on PR #5081: URL: https://github.com/apache/hadoop/pull/5081#issuecomment-2116176630 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-18325) ABFS: Add correlated metric support for ABFS operations

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847037#comment-17847037 ] ASF GitHub Bot commented on HADOOP-18325: - steveloughran commented on PR #6314: URL:

Re: [PR] HADOOP-18325: ABFS: Add correlated metric support for ABFS operations [hadoop]

2024-05-16 Thread via GitHub
steveloughran commented on PR #6314: URL: https://github.com/apache/hadoop/pull/6314#issuecomment-2115790916 @anmolanmol1234 you got any timeline for changes here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847028#comment-17847028 ] ASF GitHub Bot commented on HADOOP-14837: - steveloughran commented on code in PR #6407: URL:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-05-16 Thread via GitHub
steveloughran commented on code in PR #6407: URL: https://github.com/apache/hadoop/pull/6407#discussion_r1603436149 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java: ## @@ -585,6 +592,18 @@ public void initialize(URI name, Configuration

[jira] [Resolved] (HADOOP-18759) [ABFS][Backoff-Optimization] Have a Static retry policy for connection timeout failures

2024-05-16 Thread Anuj Modi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuj Modi resolved HADOOP-18759. Fix Version/s: 3.4.1 (was: 3.5.0) Release Note:

[jira] [Resolved] (HADOOP-18011) ABFS: Enable config control for default connection timeout

2024-05-16 Thread Anuj Modi (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anuj Modi resolved HADOOP-18011. Fix Version/s: 3.4.1 Hadoop Flags: Reviewed Release Note:

Re: [PR] YARN-11471. [Federation] FederationStateStoreFacade Cache Support Caffeine. [hadoop]

2024-05-16 Thread via GitHub
hadoop-yetus commented on PR #6795: URL: https://github.com/apache/hadoop/pull/6795#issuecomment-2115593583 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HDFS-17518: Sync the editslog if a file is closed in the lease monitor [hadoop]

2024-05-16 Thread via GitHub
ThinkerLei commented on code in PR #6809: URL: https://github.com/apache/hadoop/pull/6809#discussion_r1603594294 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/LeaseManager.java: ## @@ -626,7 +626,8 @@ private synchronized boolean

[jira] [Commented] (HADOOP-19172) Upgrade aws-java-sdk to 1.12.720

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846965#comment-17846965 ] ASF GitHub Bot commented on HADOOP-19172: - steveloughran merged PR #6829: URL:

[jira] [Resolved] (HADOOP-19172) Upgrade aws-java-sdk to 1.12.720

2024-05-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19172. - Fix Version/s: 3.3.9 3.5.0 3.4.1

Re: [PR] HADOOP-19172. S3A: upgrade AWS v1 sdk to 1.12.720 (#6823) [hadoop]

2024-05-16 Thread via GitHub
steveloughran merged PR #6829: URL: https://github.com/apache/hadoop/pull/6829 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HDFS-17518: Sync the editslog if a file is closed in the lease monitor [hadoop]

2024-05-16 Thread via GitHub
vinayakumarb commented on code in PR #6809: URL: https://github.com/apache/hadoop/pull/6809#discussion_r160870 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/LeaseManager.java: ## @@ -626,7 +626,8 @@ private synchronized boolean

[jira] [Commented] (HADOOP-19161) S3A: option "fs.s3a.performance.flags" to take list of performance flags

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846932#comment-17846932 ] ASF GitHub Bot commented on HADOOP-19161: - steveloughran commented on PR #6789: URL:

Re: [PR] HADOOP-19161. S3A: option "fs.s3a.performance.flags" to take list of performance flags [hadoop]

2024-05-16 Thread via GitHub
steveloughran commented on PR #6789: URL: https://github.com/apache/hadoop/pull/6789#issuecomment-2115097967 ``` Reason: Use hadoop-common provided Sets rather than Guava provided Sets in file: org/apache/hadoop/util/ConfigurationUtil.java

[jira] [Commented] (HADOOP-19167) Change of Codec configuration does not work

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846931#comment-17846931 ] ASF GitHub Bot commented on HADOOP-19167: - steveloughran commented on PR #6807: URL:

Re: [PR] HADOOP-19167 Bug Fix: Change of Codec configuration does not work [hadoop]

2024-05-16 Thread via GitHub
steveloughran commented on PR #6807: URL: https://github.com/apache/hadoop/pull/6807#issuecomment-2115095348 @ZanderXu should have the right permissions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HDFS-17521. Erasure Coding: Fix calculation errors caused by special index order [hadoop]

2024-05-16 Thread via GitHub
zhangshuyan0 commented on PR #6813: URL: https://github.com/apache/hadoop/pull/6813#issuecomment-2114986048 @zhengchenyu Thanks for your reply. I agree. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HDFS-17521. Erasure Coding: Fix calculation errors caused by special index order [hadoop]

2024-05-16 Thread via GitHub
zhengchenyu commented on PR #6813: URL: https://github.com/apache/hadoop/pull/6813#issuecomment-2114792376 > @zhengchenyu Thanks for your explanation! I got it. This PR LGTM. I'm just curious about one thing now: when does the parity index precede the data index in current code? I haven't

Re: [PR] HDFS-17521. Erasure Coding: Fix calculation errors caused by special index order [hadoop]

2024-05-16 Thread via GitHub
zhangshuyan0 commented on PR #6813: URL: https://github.com/apache/hadoop/pull/6813#issuecomment-2114775230 @zhengchenyu Thanks for your explanation! I got it. This PR LGTM. I'm just curious about one thing now: when does the parity index precede the data index in current code? I

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846891#comment-17846891 ] ASF GitHub Bot commented on HADOOP-14837: - hadoop-yetus commented on PR #6407: URL:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-05-16 Thread via GitHub
hadoop-yetus commented on PR #6407: URL: https://github.com/apache/hadoop/pull/6407#issuecomment-2114733132 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846883#comment-17846883 ] ASF GitHub Bot commented on HADOOP-14837: - bpahuja commented on PR #6407: URL:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-05-16 Thread via GitHub
bpahuja commented on PR #6407: URL: https://github.com/apache/hadoop/pull/6407#issuecomment-2114600740 @steveloughran , I have pushed the changes for `ITestS3AReadRestoredGlacierObjects.java` , and it now has only 1 test with all the test cases. In total , the setup happens twice, once for

[jira] [Commented] (HADOOP-14837) Handle S3A "glacier" data

2024-05-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17846882#comment-17846882 ] ASF GitHub Bot commented on HADOOP-14837: - bpahuja commented on code in PR #6407: URL:

Re: [PR] HADOOP-14837 : Support Read Restored Glacier Objects [hadoop]

2024-05-16 Thread via GitHub
bpahuja commented on code in PR #6407: URL: https://github.com/apache/hadoop/pull/6407#discussion_r1602914173 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/api/S3ObjectStorageClassFilter.java: ## @@ -0,0 +1,93 @@ +/* + * Licensed to the Apache Software