[jira] [Updated] (HUDI-8139) Allow high priority writer to force-acquire lock within a bounded amount of time

[ https://issues.apache.org/jira/browse/HUDI-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-8139: --- Description: *Issue* When using HUDI multiwriter with optimistic concurrency mode enabled, a writer's

[jira] [Updated] (HUDI-8139) Allow high priority writer to force-acquire lock within a bounded amount of time

[ https://issues.apache.org/jira/browse/HUDI-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-8139: --- Description: *Issue* When using HUDI multiwriter with optimistic concurrency mode enabled, a writer's

[jira] [Updated] (HUDI-8139) Allow high priority writer to force-acquire lock within a bounded amount of time

[ https://issues.apache.org/jira/browse/HUDI-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-8139: --- Description: *Issue* When using HUDI multiwriter with optimistic concurrency mode enabled, a writer's

[jira] [Updated] (HUDI-8139) Allow high priority writer to force-acquire lock within a bounded amount of time

[ https://issues.apache.org/jira/browse/HUDI-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-8139: --- Description: *Issue* When using HUDI multiwriter with optimistic concurrency mode enabled, a writer's

[jira] [Updated] (HUDI-8139) Allow high priority writer to force-acquire lock within a bounded amount of time

[ https://issues.apache.org/jira/browse/HUDI-8139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-8139: --- Description: *Issue* When using HUDI multiwriter with optimistic concurrency mode enabled, a writer's

[jira] [Created] (HUDI-8139) Allow high priority writer to force-acquire lock within a bounded amount of time

Krishen Bhan created HUDI-8139: -- Summary: Allow high priority writer to force-acquire lock within a bounded amount of time Key: HUDI-8139 URL: https://issues.apache.org/jira/browse/HUDI-8139 Project: Apa

[jira] [Created] (HUDI-8138) Filtering of clustering replacecommits should be resilient to ongoing replacecommit rollbacks

Krishen Bhan created HUDI-8138: -- Summary: Filtering of clustering replacecommits should be resilient to ongoing replacecommit rollbacks Key: HUDI-8138 URL: https://issues.apache.org/jira/browse/HUDI-8138

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Attachment: Flowchart (2)-2.png Description: *Scenarios:* Although HUDI operations hold a table

[jira] [Created] (HUDI-7946) [Umbrella] RFC-79 : Improving reliability of concurrent table service executions and rollbacks

Krishen Bhan created HUDI-7946: -- Summary: [Umbrella] RFC-79 : Improving reliability of concurrent table service executions and rollbacks Key: HUDI-7946 URL: https://issues.apache.org/jira/browse/HUDI-7946

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: *Scenarios:* Although HUDI operations hold a table lock when creating a .requested insta

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: *Scenarios:* Although HUDI operations hold a table lock when creating a .requested insta

[jira] [Created] (HUDI-7687) Instant should not be archived until replaced file groups or older file versions are deleted

Krishen Bhan created HUDI-7687: -- Summary: Instant should not be archived until replaced file groups or older file versions are deleted Key: HUDI-7687 URL: https://issues.apache.org/jira/browse/HUDI-7687

[jira] [Updated] (HUDI-7655) Support configuration for clean to fail execution if there is at least one file is marked as a failed delete

[ https://issues.apache.org/jira/browse/HUDI-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7655: --- Description: When a HUDI clean plan is executed, any targeted file that was not confirmed as deleted

[jira] [Created] (HUDI-7655) Support configuration for clean to fail execution if there is at least one file is marked as a failed delete

Krishen Bhan created HUDI-7655: -- Summary: Support configuration for clean to fail execution if there is at least one file is marked as a failed delete Key: HUDI-7655 URL: https://issues.apache.org/jira/browse/HUDI-76

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: *Scenarios:* Although HUDI operations hold a table lock when creating a .requested insta

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: *Scenarios:* Although HUDI operations hold a table lock when creating a .requested insta

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: *Scenarios:* Although HUDI operations hold a table lock when creating a .requested insta

[jira] [Updated] (HUDI-7503) concurrent executions of table service plan should not corrupt dataset

[ https://issues.apache.org/jira/browse/HUDI-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7503: --- Summary: concurrent executions of table service plan should not corrupt dataset (was: concurrent exec

[jira] [Commented] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17832306#comment-17832306 ] Krishen Bhan commented on HUDI-7507: I removed the original alternate approach I added

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: Although HUDI operations hold a table lock when creating a .requested instant, because H

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Description: Although HUDI operations hold a table lock when creating a .requested instant, because H

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Attachment: Flowchart (1).png > ongoing concurrent writers with smaller timestamp can cause issues wi

[jira] [Updated] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

[ https://issues.apache.org/jira/browse/HUDI-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7507: --- Attachment: Flowchart.png Description: Although HUDI operations hold a table lock when creating a

[jira] [Created] (HUDI-7507) ongoing concurrent writers with smaller timestamp can cause issues with table services

Krishen Bhan created HUDI-7507: -- Summary: ongoing concurrent writers with smaller timestamp can cause issues with table services Key: HUDI-7507 URL: https://issues.apache.org/jira/browse/HUDI-7507 Proje

[jira] [Updated] (HUDI-7503) concurrent executions of compaction plan should not corrupt dataset

[ https://issues.apache.org/jira/browse/HUDI-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7503: --- Description: Currently it is not safe for 2+ writers to concurrently call `org.apache.hudi.client.Bas

[jira] [Created] (HUDI-7503) concurrent executions of compaction plan should not corrupt dataset

Krishen Bhan created HUDI-7503: -- Summary: concurrent executions of compaction plan should not corrupt dataset Key: HUDI-7503 URL: https://issues.apache.org/jira/browse/HUDI-7503 Project: Apache Hudi

[jira] [Updated] (HUDI-7337) Implement MetricsReporter for M3

[ https://issues.apache.org/jira/browse/HUDI-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7337: --- Description: Add a new implementation of org.apache.hudi.metrics.MetricsReporter that reports metrics

[jira] [Created] (HUDI-7337) Implement MetricsReporter for M3

Krishen Bhan created HUDI-7337: -- Summary: Implement MetricsReporter for M3 Key: HUDI-7337 URL: https://issues.apache.org/jira/browse/HUDI-7337 Project: Apache Hudi Issue Type: Wish Com

[jira] [Created] (HUDI-7316) AbstractHoodieLogRecordReader should accept already-constructed HoodieTableMetaClient in order to reduce occurrences of file listing calls when reloading active timeline

Krishen Bhan created HUDI-7316: -- Summary: AbstractHoodieLogRecordReader should accept already-constructed HoodieTableMetaClient in order to reduce occurrences of file listing calls when reloading active timeline Key: HUDI-7316

[jira] [Created] (HUDI-7313) ZookeeperBasedLockProvider should store application info in lock node

Krishen Bhan created HUDI-7313: -- Summary: ZookeeperBasedLockProvider should store application info in lock node Key: HUDI-7313 URL: https://issues.apache.org/jira/browse/HUDI-7313 Project: Apache Hudi

[jira] [Updated] (HUDI-7308) LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started

[ https://issues.apache.org/jira/browse/HUDI-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-7308: --- Status: In Progress (was: Open) > LockManager::unlock should not call updateLockHeldTimerMetrics if

[jira] [Created] (HUDI-7308) LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started

Krishen Bhan created HUDI-7308: -- Summary: LockManager::unlock should not call updateLockHeldTimerMetrics if lockDurationTimer has not been started Key: HUDI-7308 URL: https://issues.apache.org/jira/browse/HUDI-7308

[jira] [Comment Edited] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751866#comment-17751866 ] Krishen Bhan edited comment on HUDI-6596 at 8/17/23 7:47 PM: -

[jira] [Commented] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17755672#comment-17755672 ] Krishen Bhan commented on HUDI-6596: {quote}  I think we should use a different name t

[jira] [Comment Edited] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751866#comment-17751866 ] Krishen Bhan edited comment on HUDI-6596 at 8/8/23 11:48 PM: -

[jira] [Commented] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751866#comment-17751866 ] Krishen Bhan commented on HUDI-6596: I was going to create my PR [https://github.com/k

[jira] [Commented] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751201#comment-17751201 ] Krishen Bhan commented on HUDI-6596: Sorry I realized that I might now have fully addr

[jira] [Comment Edited] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750879#comment-17750879 ] Krishen Bhan edited comment on HUDI-6596 at 8/3/23 8:15 PM: Th

[jira] [Commented] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17750879#comment-17750879 ] Krishen Bhan commented on HUDI-6596: Thanks for the reply! > The table lock could beco

[jira] [Updated] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-6596: --- Description: h1. Issue The existing rollback API in 0.14 [https://github.com/apache/hudi/blob/master

[jira] [Updated] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-6596: --- Description: h1. Issue The existing rollback API in 0.14 [https://github.com/apache/hudi/blob/master

[jira] [Updated] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-6596: --- Description: h1. Issue The existing rollback API in 0.14 [https://github.com/apache/hudi/blob/master

[jira] [Updated] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-6596: --- Description: h1. Issue The existing rollback API in 0.14 [https://github.com/apache/hudi/blob/master

[jira] [Updated] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

[ https://issues.apache.org/jira/browse/HUDI-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishen Bhan updated HUDI-6596: --- Description: h1. Issue The existing rollback API in 0.14 [https://github.com/apache/hudi/blob/master

[jira] [Created] (HUDI-6596) Propose rollback implementation changes to guard against concurrent jobs

Krishen Bhan created HUDI-6596: -- Summary: Propose rollback implementation changes to guard against concurrent jobs Key: HUDI-6596 URL: https://issues.apache.org/jira/browse/HUDI-6596 Project: Apache Hud