+1 this is a very helpful feature

On Wed, Apr 23, 2025 at 2:19 AM Voon <v...@apache.org> wrote:

> Hi all,
>
> I have created a PR https://github.com/apache/hudi/pull/13152 for RFC-94
> for Hudi Timeline User Interface (UI).
>
> *Problem Statement:*
> Analysing Hudi Timeline files are quite tedious when debugging, especially
> when they are encoded in an Avro binary. The only way to navigate or browse
> the timeline is to use a CLI or a file browser to list out the files under
> .hoodie. Doing this, we often have a rough time identifying concurrent
> operations, long running tasks or even jobs that are sometimes stuck.
>
> *Solution:*
> Similar to how Spark-Web-UI renders Event Timeline that displays in
> chronological order the events related to the executors (added, removed)
> and the jobs, we can also render Hudi Timeline using a similar approach,
> and all these will only require a list file operation of the .hoodie
> directory.
>
> This UI can be extended to also show incremental clean range, i.e. which
> timelines are cleaned and allow users to view instants content by decoding
> the avro binary to JSON.
>
> A simple PoC is implemented in this PR:
> https://github.com/apache/hudi/pull/13147
>
> As of now, the simple PoC is implemented in plain HTML and vanilla
> javascript without any CSS libraries, I will leave the decision of the CSS
> library up to the community.
>
> PTAL, any feedback will be appreciated.
>
> Cheers,
> Voon
>


-- 
Best,
Shiyan

Reply via email to