Thanks Krishen! Any volunteers to review the RFC?

On Mon, Mar 10, 2025 at 4:26 PM Krishen Bhan <bhan.kris...@gmail.com> wrote:

> Hi all,
>
> I have created a PR https://github.com/apache/hudi/pull/12856 for RFC
> 90 for enabling clustering plans to be "cancellable"
>
> Background:
>
> Clustering is a table service that assists with optimizing table/files
> layout in Hudi to speed up read queries. Clustering table service
> plans can delay
> ingestion writes from updating a dataset with recent data if potential
> write conflicts are detected. Furthermore, a clustering plan that
> isn't executed to completion for a large amount of time (due to
> repeated failures, application
> misconfiguration, or insufficient resources) will degrade the
> read/write performance of a dataset due to delaying clean and
> archival. This
> RFC proposes to support "Cancellable" Clustering plans. Support for
> such cancellable clustering plans will provide HUDI an avenue to fully
> cancel a clustering plan to allow other table service and ingestion
> writers to proceed and avoid possible starvation (based on user
> needs).
>
> Thanks, and any feedback will be appreciated.
> --
> From, Krishen Bhan
>

Reply via email to