Re: [PR] HDDS-11483. Make s3g object get and put operation buffer configurable [ozone]

2024-10-15 Thread via GitHub
ChenSammi commented on PR #7233: URL: https://github.com/apache/ozone/pull/7233#issuecomment-2415877301 @kerneltime , thanks for the new data. As 4MB can improve the s3g write performance, it's make sense to make it default. Could you help to review the patch again? -- This is an

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
slfan1989 commented on PR #7249: URL: https://github.com/apache/ozone/pull/7249#issuecomment-2415810961 > @slfan1989 Thanks for the explanation, LGTM. @ashishkumar50 Thank you very much for helping to review the code! -- This is an automated message from the Apache Git Service. To r

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
slfan1989 commented on PR #7249: URL: https://github.com/apache/ozone/pull/7249#issuecomment-2415810267 > @slfan1989 two of comment is still pending... @sumitagrawl Could you please help review this PR again? Thank you very much! -- This is an automated message from the Apache Git S

Re: [PR] HDDS-11108. Extract keywords for multipart upload tests [ozone]

2024-10-15 Thread via GitHub
ivandika3 commented on PR #7318: URL: https://github.com/apache/ozone/pull/7318#issuecomment-2415802161 Also maybe we can rename `MultipartUpload.robot` to `multipartupload.robot` just to standardize the naming. I'm fine to leave it as it is. -- This is an automated message from the Apach

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11585: -- Labels: pull-request-available (was: ) > Add DN Ratis log purge parameters to close pipeline w

[PR] HDDS-11585. Add DN Ratis log purge parameters to close pipeline with slow follower [ozone]

2024-10-15 Thread via GitHub
ivandika3 opened a new pull request, #7319: URL: https://github.com/apache/ozone/pull/7319 ## What changes were proposed in this pull request? Ozone Ratis pipeline seem to have an indirect mechanism to detect follower with lagging follower index (i.e. "slow follower") through the not

[jira] [Updated] (HDDS-11108) Extract keywords for multipart upload tests

2024-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11108: -- Labels: pull-request-available (was: ) > Extract keywords for multipart upload tests > ---

[jira] [Updated] (HDDS-9221) Check if the data size and block total size are equal when commit key

2024-10-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDDS-9221: -- Labels: new-bie (was: ) > Check if the data size and block total size are equal when co

[PR] HDDS-11108. Extract keywords for multipart upload tests [ozone]

2024-10-15 Thread via GitHub
adoroszlai opened a new pull request, #7318: URL: https://github.com/apache/ozone/pull/7318 ## What changes were proposed in this pull request? Refactor `MultipartUpload.robot` by extracting reusable Robot keywords for test steps. Also, reduce the number of temp files created f

[jira] [Commented] (HDDS-8344) Failed to open container's rocksdb

2024-10-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889924#comment-17889924 ] Uma Maheswara Rao G commented on HDDS-8344: --- [~Symious] [~Sammi] is this still a

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have an indirect mechanism to detect follower with lagging

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have an indirect mechanism to detect "slow follower" throu

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have an indirect mechanism to detect "slow follower" throu

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have an indirect mechanism to detect "slow follower" throu

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have indirect mechanism to detect "slow follower" through

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have indirect mechanism to detect "slow follower" through

[jira] [Commented] (HDDS-7001) OMTenantCreateRequest#validateAndUpdateCache might not release lock when exception is thrown

2024-10-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889921#comment-17889921 ] Uma Maheswara Rao G commented on HDDS-7001: --- [~ritesh] [~smeng] is this still a

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have indirect mechanism to detect "slow follower" through

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have indirect mechanism to detect "slow follower" through

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have indirect mechanism to detect "slow follower" through

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Description: Ozone Ratis pipeline seem to have indirect mechanism to detect "slow follower" through

[jira] [Commented] (HDDS-7216) Ozone S3g leak ratis GRPC messages metrics

2024-10-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889915#comment-17889915 ] Sammi Chen commented on HDDS-7216: -- Sure, I resolved the Jira. > Ozone S3g leak ratis G

[jira] [Resolved] (HDDS-7216) Ozone S3g leak ratis GRPC messages metrics

2024-10-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-7216. -- Resolution: Fixed > Ozone S3g leak ratis GRPC messages metrics > ---

[jira] [Commented] (HDDS-7992) Copy and move command for MPU objects from awscli v2 not working

2024-10-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889911#comment-17889911 ] Uma Maheswara Rao G commented on HDDS-7992: --- We support object tagging now. [~ku

Re: [PR] HDDS-11578. Rename snapshot dir constant in OzoneConsts [ozone]

2024-10-15 Thread via GitHub
weimingdiit commented on PR #7310: URL: https://github.com/apache/ozone/pull/7310#issuecomment-2415589637 @sarvekshayr @Tejaskriya Thanks for your review ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to close pipeline with slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Summary: Add DN Ratis log purge parameters to close pipeline with slow follower (was: Add DN Ratis l

[jira] [Commented] (HDDS-7693) EC: Multiple UNHEALTHY replicas are added in a CLOSED container for the same index

2024-10-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889905#comment-17889905 ] Uma Maheswara Rao G commented on HDDS-7693: --- I think this issue is fixed already

[jira] [Commented] (HDDS-7216) Ozone S3g leak ratis GRPC messages metrics

2024-10-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889904#comment-17889904 ] Uma Maheswara Rao G commented on HDDS-7216: --- I think the referred Jira has alrea

[jira] [Commented] (HDDS-7037) pipeline not found issue in 1.3.0-SNAPSHOT

2024-10-15 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889903#comment-17889903 ] Uma Maheswara Rao G commented on HDDS-7037: --- I think we have made significant im

[jira] [Updated] (HDDS-11585) Add DN Ratis log purge parameters to detect slow follower

2024-10-15 Thread Ivan Andika (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Andika updated HDDS-11585: --- Attachment: (was: image-2024-10-15-11-40-41-618.png) > Add DN Ratis log purge parameters to detec

[jira] [Commented] (HDDS-8175) getFileChecksum() throws exception in debug mode

2024-10-15 Thread Hsu Han Wen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889889#comment-17889889 ] Hsu Han Wen commented on HDDS-8175: --- Hi, I'm interested in this issue. Would it be okay

Re: [PR] HDDS-10338. Implement a Client Datanode API to stream a block [ozone]

2024-10-15 Thread via GitHub
kerneltime commented on code in PR #6613: URL: https://github.com/apache/ozone/pull/6613#discussion_r1802096576 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java: ## @@ -618,6 +624,69 @@ private void decreasePendingMetricsAndReleaseSemaphore()

Re: [PR] HDDS-10338. Implement a Client Datanode API to stream a block [ozone]

2024-10-15 Thread via GitHub
kerneltime commented on code in PR #6613: URL: https://github.com/apache/ozone/pull/6613#discussion_r1802076166 ## hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/XceiverClientGrpc.java: ## @@ -108,12 +110,12 @@ public class XceiverClientGrpc extends XceiverClientSpi

Re: [PR] HDDS-10338. Implement a Client Datanode API to stream a block [ozone]

2024-10-15 Thread via GitHub
kerneltime commented on code in PR #6613: URL: https://github.com/apache/ozone/pull/6613#discussion_r1802072637 ## hadoop-hdds/client/src/test/java/org/apache/hadoop/hdds/scm/storage/TestStreamBlockInput.java: ## @@ -0,0 +1,259 @@ +/* + * Licensed to the Apache Software Foundati

Re: [PR] HDDS-10338. Implement a Client Datanode API to stream a block [ozone]

2024-10-15 Thread via GitHub
kerneltime commented on code in PR #6613: URL: https://github.com/apache/ozone/pull/6613#discussion_r1802072873 ## hadoop-hdds/client/dev-support/findbugsExcludeFile.xml: ## @@ -32,4 +32,8 @@ + + + + Review Comment: This applies to all the places

Re: [PR] HDDS-11509. logging improvements for directory deletion [ozone]

2024-10-15 Thread via GitHub
aryangupta1998 commented on PR #7314: URL: https://github.com/apache/ozone/pull/7314#issuecomment-2414921097 Thanks, @Tejaskriya for the patch. Regarding the master [jira](https://issues.apache.org/jira/browse/HDDS-11506), I anticipate significant changes to the deletion code. So, I think w

[jira] [Commented] (HDDS-11558) HBase RegionServer crashes due to inconsistency caused by Ozone client failover handling

2024-10-15 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889807#comment-17889807 ] Tsz-wo Sze commented on HDDS-11558: --- The problem here is that Ozone is using its own im

Re: [PR] HDDS-11566. Replication tasks add transferredBytes and queuedTime metrics [ozone]

2024-10-15 Thread via GitHub
errose28 commented on PR #7306: URL: https://github.com/apache/ozone/pull/7306#issuecomment-2414678032 We should have some way to approximate how much network traffic is happening due to replication tasks. To really visualize this it would have to go in a dashboard. I think this would look

[jira] [Updated] (HDDS-11068) OM down to Snapshot Chain Corruption

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11068: -- Fix Version/s: 1.4.1 Target Version/s: 1.4.1 > OM down to Snapshot Chain Corruption > --

[jira] [Updated] (HDDS-10218) Speed up TestSstFilteringService

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10218: -- Fix Version/s: 1.4.1 Target Version/s: 1.4.1 > Speed up TestSstFilteringService > --

[jira] [Updated] (HDDS-10143) Intermittent failure in testParallelDeleteBucketAndCreateKey

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10143: -- Fix Version/s: 1.4.1 Target Version/s: 1.4.1 > Intermittent failure in testParallelDeleteBucketAndCreate

[jira] [Updated] (HDDS-11084) Read SstFilteringService config once and reuse it

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11084: -- Fix Version/s: 1.4.1 Target Version/s: 1.4.1 > Read SstFilteringService config once and reuse it > -

[jira] [Updated] (HDDS-10059) Intermittent failure in TestOMRatisSnapshots.testInstallSnapshot

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10059: -- Fix Version/s: 1.4.1 Target Version/s: 1.4.1 > Intermittent failure in TestOMRatisSnapshots.testInstallS

[jira] [Updated] (HDDS-10780) NullPointerException in watchForCommit

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10780: -- Target Version/s: 1.4.1 > NullPointerException in watchForCommit > -- > >

[jira] [Updated] (HDDS-11320) Update OM, SCM, Datanode conf for RATIS-2135.

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11320: -- Fix Version/s: 1.4.1 > Update OM, SCM, Datanode conf for RATIS-2135. >

[jira] [Updated] (HDDS-10773) Simplify OM RaftProperties formatting

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10773: -- Fix Version/s: 1.4.1 > Simplify OM RaftProperties formatting > - > >

[jira] [Updated] (HDDS-9889) Refactor tests related to dynamical adaptation for datanode limits in ContainerBalancer

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-9889: - Fix Version/s: 1.4.1 > Refactor tests related to dynamical adaptation for datanode limits in > ContainerBalancer

[jira] [Updated] (HDDS-8900) Intermittent failure in TestSecretKeysApi#testSecretKeyApiSuccess

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-8900: - Fix Version/s: 1.4.1 > Intermittent failure in TestSecretKeysApi#testSecretKeyApiSuccess > ---

[jira] [Updated] (HDDS-11309) Increase CONTAINER_STATE Column Length in UNHEALTHY_CONTAINERS Table to Avoid Truncation Errors for Enum States

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11309: -- Fix Version/s: 1.4.1 > Increase CONTAINER_STATE Column Length in UNHEALTHY_CONTAINERS Table to Avoid > Truncat

[jira] [Updated] (HDDS-11331) Fix Datanode unable to report for a long time

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11331: -- Fix Version/s: 1.4.1 > Fix Datanode unable to report for a long time >

[jira] [Updated] (HDDS-11375) DN Startup fails with Illegal configuration

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11375: -- Fix Version/s: 1.4.1 > DN Startup fails with Illegal configuration > --

[jira] [Updated] (HDDS-9198) Snapshot purge should be a atomic operation

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-9198: - Fix Version/s: 1.4.1 > Snapshot purge should be a atomic operation > --- >

[jira] [Updated] (HDDS-10761) Add raft close threshold config to OM RaftProperties

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10761: -- Fix Version/s: 1.4.1 > Add raft close threshold config to OM RaftProperties > -

[jira] [Updated] (HDDS-10293) IllegalArgumentException: containerSize Negative

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10293: -- Fix Version/s: 1.4.1 > IllegalArgumentException: containerSize Negative > -

[jira] [Updated] (HDDS-11209) Avoid insufficient EC pipelines in the container pipeline cache

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11209: -- Fix Version/s: 1.4.1 > Avoid insufficient EC pipelines in the container pipeline cache > --

[jira] [Updated] (HDDS-10985) EC Reconstruction failed because the size of currentChunks was not equal to checksumBlockDataChunks

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10985: -- Fix Version/s: 1.4.1 > EC Reconstruction failed because the size of currentChunks was not equal to > checksumB

[jira] [Updated] (HDDS-9819) Recon - Potential memory overflow in Container Health Task

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-9819: - Fix Version/s: 1.4.1 > Recon - Potential memory overflow in Container Health Task > --

[jira] [Updated] (HDDS-10612) Add Robot test to verify Container Balancer for RATIS containers

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-10612: -- Fix Version/s: 1.4.1 > Add Robot test to verify Container Balancer for RATIS containers > -

[jira] [Updated] (HDDS-11152) OMDoubleBuffer error when handling OMRequest: cmdType: SnapshotMoveDeletedKeys

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11152: -- Fix Version/s: 1.4.1 > OMDoubleBuffer error when handling OMRequest: cmdType: SnapshotMoveDeletedKeys > ---

[jira] [Updated] (HDDS-11137) Remove the locks from SnapshotPurge and SnapshotSetProperty APIs

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-11137: -- Fix Version/s: 1.4.1 > Remove the locks from SnapshotPurge and SnapshotSetProperty APIs > -

[jira] [Updated] (HDDS-8900) Intermittent failure in TestSecretKeysApi#testSecretKeyApiSuccess

2024-10-15 Thread ChenXi (Jira)
[ https://issues.apache.org/jira/browse/HDDS-8900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ChenXi updated HDDS-8900: - Target Version/s: 2.0.0, 1.4.1 > Intermittent failure in TestSecretKeysApi#testSecretKeyApiSuccess > -

Re: [PR] HDDS-10928. Implement container comparison and repair logic within datanodes. [ozone]

2024-10-15 Thread via GitHub
kerneltime commented on code in PR #7293: URL: https://github.com/apache/ozone/pull/7293#discussion_r1801615827 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/checksum/ContainerChecksumTreeManager.java: ## @@ -143,12 +148,81 @@ public void markB

[jira] [Resolved] (HDDS-10377) Allow datanodes to do chunk level modifications to closed containers

2024-10-15 Thread Aswin Shakil (Jira)
[ https://issues.apache.org/jira/browse/HDDS-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aswin Shakil resolved HDDS-10377. - Fix Version/s: 2.0.0 Resolution: Fixed > Allow datanodes to do chunk level modifications t

Re: [PR] HDDS-7307. Move S3 Gateway web content to separate port [ozone]

2024-10-15 Thread via GitHub
errose28 commented on PR #6898: URL: https://github.com/apache/ozone/pull/6898#issuecomment-2414557225 +1 for putting this in 2.0. I'll increase the priority of reviewing this from my side. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (HDDS-11511) All deletion services should have consistent metrics

2024-10-15 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889755#comment-17889755 ] Ethan Rose commented on HDDS-11511: --- Thanks for looking into this [~tejaskriya09]. It l

Re: [PR] HDDS-10928. Implement container comparison and repair logic within datanodes. [ozone]

2024-10-15 Thread via GitHub
kerneltime commented on code in PR #7293: URL: https://github.com/apache/ozone/pull/7293#discussion_r1801557751 ## hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/checksum/ContainerChecksumTreeManager.java: ## @@ -143,12 +148,81 @@ public void markB

Re: [PR] HDDS-11072. Publish user-facing configs to the doc site [ozone]

2024-10-15 Thread via GitHub
errose28 commented on PR #6916: URL: https://github.com/apache/ozone/pull/6916#issuecomment-2414488337 Hi @sarvekshayr can you temporarily modify this change to use the `OZONE_WEBSITE_BUILD` secret per [INFRA-26150](https://issues.apache.org/jira/browse/INFRA-26150) to raise a test pull r

[jira] [Created] (HDDS-11588) Add main artifact jar to classpath file

2024-10-15 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-11588: --- Summary: Add main artifact jar to classpath file Key: HDDS-11588 URL: https://issues.apache.org/jira/browse/HDDS-11588 Project: Apache Ozone Issue Type

Re: [PR] HDDS-11503. Add Robot test to verify Container Balancer for EC containers. [ozone]

2024-10-15 Thread via GitHub
Daniilchik commented on PR #7311: URL: https://github.com/apache/ozone/pull/7311#issuecomment-2414399239 I have updated this patch, now we can use a single docker-compose file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[jira] [Commented] (HDDS-11513) All deletion configurations should be configurable without restart

2024-10-15 Thread Sadanand Shenoy (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889701#comment-17889701 ] Sadanand Shenoy commented on HDDS-11513: Looks like some of the properties are al

[jira] [Resolved] (HDDS-7876) Changing base branch should trigger CI.

2024-10-15 Thread Sadanand Shenoy (Jira)
[ https://issues.apache.org/jira/browse/HDDS-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sadanand Shenoy resolved HDDS-7876. --- Resolution: Won't Fix > Changing base branch should trigger CI. >

[jira] [Updated] (HDDS-11586) Remove duplicate OzoneManagerProtocolServerSideTranslatorPB#OM_REQUESTS_PACKAGE

2024-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11586: -- Labels: pull-request-available (was: ) > Remove duplicate > OzoneManagerProtocolServerSideTra

Re: [PR] HDDS-11586. Remove duplicate OzoneManagerProtocolServerSideTranslatorPB#OM_REQUESTS_PACKAGE [ozone]

2024-10-15 Thread via GitHub
jianghuazhu commented on PR #7317: URL: https://github.com/apache/ozone/pull/7317#issuecomment-2413521815 @fapifta @adoroszlai , can you help review this PR? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] HDDS-11586. Remove duplicate OzoneManagerProtocolServerSideTranslatorPB#OM_REQUESTS_PACKAGE [ozone]

2024-10-15 Thread via GitHub
jianghuazhu opened a new pull request, #7317: URL: https://github.com/apache/ozone/pull/7317 ## What changes were proposed in this pull request? The same validation package is defined in OzoneManagerProtocolServerSideTranslatorPB and RequestValidations, so you only need to keep one o

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
slfan1989 commented on code in PR #7249: URL: https://github.com/apache/ozone/pull/7249#discussion_r1800851069 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -369,12 +372,13 @@ public DatanodeDeletedBlockTransactions getT

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
slfan1989 commented on code in PR #7249: URL: https://github.com/apache/ozone/pull/7249#discussion_r1800851069 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -369,12 +372,13 @@ public DatanodeDeletedBlockTransactions getT

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
slfan1989 commented on code in PR #7249: URL: https://github.com/apache/ozone/pull/7249#discussion_r1800843706 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -300,11 +285,29 @@ private void getTransaction(DeletedBlocksTra

[jira] [Updated] (HDDS-11587) Ozone Manager not processing file put requests while enabling multi-tenancy

2024-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-11587: -- Labels: pull-request-available (was: ) > Ozone Manager not processing file put requests while

[PR] HDDS-11587. Ozone Manager not processing file put requests while enabling multi-tenancy [ozone]

2024-10-15 Thread via GitHub
ChenSammi opened a new pull request, #7316: URL: https://github.com/apache/ozone/pull/7316 ## What changes were proposed in this pull request? Fix the problem that Ozone Manager fail to process write requests while enabling multi-tenancy The root cause analysis is shared in the ht

[jira] [Created] (HDDS-11587) Ozone Manager not processing file put requests while enabling multi-tenancy

2024-10-15 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-11587: - Summary: Ozone Manager not processing file put requests while enabling multi-tenancy Key: HDDS-11587 URL: https://issues.apache.org/jira/browse/HDDS-11587 Project: Apache O

Re: [PR] HDDS-11367. Improve ozone balancing status command output [ozone]

2024-10-15 Thread via GitHub
juncevich commented on code in PR #7139: URL: https://github.com/apache/ozone/pull/7139#discussion_r1800764223 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/ContainerBalancerTask.java: ## @@ -307,53 +311,53 @@ private void balance() { }

[jira] [Assigned] (HDDS-11586) Remove duplicate OzoneManagerProtocolServerSideTranslatorPB#OM_REQUESTS_PACKAGE

2024-10-15 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDDS-11586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JiangHua Zhu reassigned HDDS-11586: --- Assignee: JiangHua Zhu > Remove duplicate > OzoneManagerProtocolServerSideTranslatorPB#OM_R

[jira] [Created] (HDDS-11586) Remove duplicate OzoneManagerProtocolServerSideTranslatorPB#OM_REQUESTS_PACKAGE

2024-10-15 Thread JiangHua Zhu (Jira)
JiangHua Zhu created HDDS-11586: --- Summary: Remove duplicate OzoneManagerProtocolServerSideTranslatorPB#OM_REQUESTS_PACKAGE Key: HDDS-11586 URL: https://issues.apache.org/jira/browse/HDDS-11586 Project:

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
sumitagrawl commented on PR #7249: URL: https://github.com/apache/ozone/pull/7249#issuecomment-2413301604 @slfan1989 two of comment is still pending... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] Bump org.eclipse.jetty:jetty-http from 9.4.56.v20240826 to 12.0.12 [ozone]

2024-10-15 Thread via GitHub
dependabot[bot] commented on PR #7315: URL: https://github.com/apache/ozone/pull/7315#issuecomment-2413291881 OK, I won't notify you about version 12.x.x again, unless you re-open this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] Bump org.eclipse.jetty:jetty-http from 9.4.56.v20240826 to 12.0.12 [ozone]

2024-10-15 Thread via GitHub
adoroszlai commented on PR #7315: URL: https://github.com/apache/ozone/pull/7315#issuecomment-2413291751 @dependabot ignore this major version -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Bump org.eclipse.jetty:jetty-http from 9.4.56.v20240826 to 12.0.12 [ozone]

2024-10-15 Thread via GitHub
dependabot[bot] closed pull request #7315: Bump org.eclipse.jetty:jetty-http from 9.4.56.v20240826 to 12.0.12 URL: https://github.com/apache/ozone/pull/7315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
sumitagrawl commented on code in PR #7249: URL: https://github.com/apache/ozone/pull/7249#discussion_r1800728960 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -300,11 +285,29 @@ private void getTransaction(DeletedBlocksT

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
sumitagrawl commented on code in PR #7249: URL: https://github.com/apache/ozone/pull/7249#discussion_r1800727446 ## hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/block/DeletedBlockLogImpl.java: ## @@ -369,12 +372,13 @@ public DatanodeDeletedBlockTransactions ge

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
ashishkumar50 commented on PR #7249: URL: https://github.com/apache/ozone/pull/7249#issuecomment-2413275219 @slfan1989 Thanks for the explanation, LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HDDS-11498. Improve SCM deletion efficiency. [ozone]

2024-10-15 Thread via GitHub
slfan1989 commented on PR #7249: URL: https://github.com/apache/ozone/pull/7249#issuecomment-2413164585 > > The actual purpose of this PR is to make deletions orderly. If a certain container does not meet the conditions for deletion, we will ignore it until it satisfies the deletion conditi