Re: [ANNOUNCE] Apache HUDI 0.14.0 released

2023-10-04 Thread Kyle Weller
Super exciting news, congratulations on the hard work to everyone who
contributed!

On Wed, Oct 4, 2023 at 10:38 PM Prashant Wason 
wrote:

> The Apache Hudi team is pleased to announce the release of Apache Hudi
> 0.14.0.
>
> Apache Hudi is a transactional data lake platform that brings database and
> data warehouse capabilities to the data lake. Hudi reimagines slow
> old-school batch data processing with a powerful new incremental processing
> framework for low latency minute-level analytics.
>
> This release comes 4 months after 0.13.1. It includes more than 405
> resolved issues, new features as well as general improvements and
> bug-fixes. Some of the exciting features include:
>
>1. The introduction of Record Level Index,
>2. Support for Hudi tables with Auto-generated keys
>3. The hudi_table_changes function for incremental reads
>4. Support for Spark 3.4 and Flink 1.17
>5. New feature support for Flink - consistent hashing index, Update and
>Delete statement support
>6. Spark read and write side enhancements
>
>
> Please review the release notes
>  for details on release
> highlights, breaking changes, and behavior changes before adopting the
> 0.14.0 release. If you'd like to download the source release, you can find
> it here: https://github.com/apache/hudi/releases/tag/release-0.14.0
>
> For details on how to use Hudi, please look at the quick start page located
> at https://hudi.apache.org/docs/quick-start-guide.html
>
> We welcome your help and feedback. For more information on how to report
> problems, and to get involved, visit the project website at
> https://hudi.apache.org/
>
>
> Thanks to everyone involved!
> Prashant Wason
>


New Hudi Community Tool - Looking For Input

2022-10-04 Thread Kyle Weller
Hey Hudi friends,

I’ve heard several of you wrestle with choosing Hudi configs, building
metrics/observability for Hudi pipelines, or sometimes just gathering logs
for debugging. I am working on early designs for a lightweight, free Hudi
tool that can give out-of-the box metrics, dashboards, logs, and debug aids
for your Hudi pipelines. It may help you observe the basics of your
pipeline from things like records written, bytes/commit, partition skew
distribution, clean frequency, write operation failures, and many more
details about your writers and table services.

If this topic is interesting, or if you struggle with monitoring and tuning
your Hudi pipelines, I would love to learn about your needs and brainstorm
the designs with you. I want to explore if we can build something that is
useful for the whole community so your opinions and ideas are valuable no
matter if you are brand new or a long time Hudi expert! Use any of these 3
ways to chime in:

   1. Reply on this thread and I will reach out to you for a chat.
   2. Chime in on Hudi Slack, I cross-posted there
   3. If you don’t like talking to people, but want to share some
   ideas/feedback, use this survey link:
   https://forms.gle/uYLr8dMaLjfxxey69
   <https://forms.gle/uYLr8dMaLjfxxey69>

Thanks,
Kyle Weller


Re: New site/docs navigation

2021-10-29 Thread Kyle Weller
I just joined the mailing list . Cool good to hear it resonates well with
others. Still lots of low hanging fruit for improvements I'll work on in
subsequent PRs.

Thanks,
Kyle

On Thu, Oct 28, 2021, 9:46 PM Rajesh Mahindra  wrote:

> This is awesome! Well done Kyle.
>
> Thanks
> Rajesh
>
> On Thu, Oct 28, 2021 at 7:35 PM sagar sumit 
> wrote:
>
> > This is awesome!
> > I really like the separation of `Concepts` and `Services`. Very helpful
> for
> > Hudi users in my opinion.
> >
> > One suggestion:
> > Thinking from a newbie perspective who is thinking of adopting data lake,
> > would it be better to move the `Use Cases` section right below `Overview`
> > for better visibility?
> > For e.g. Presto/Trino have mentioned use cases right under the Overview
> > section.
> >
> > Regards,
> > Sagar
> >
> > On Thu, Oct 28, 2021 at 6:55 PM Vinoth Chandar 
> wrote:
> >
> > > Awesome!
> > > I think Kyle has already fixed some issues around cn docs in the PR
> > above.
> > > Could you review that?
> > > Kyle, if you are here, please chime in. We can organize all the work
> > under
> > > a single umbrella JIRA.
> > > https://issues.apache.org/jira/browse/HUDI-270 so its easier for any
> > > volunteers to pick up?
> > >
> > > On Thu, Oct 28, 2021 at 6:21 AM Shawy Geng 
> > > wrote:
> > >
> > > > Hi Vinoth,
> > > >
> > > > Volunteer to update the Chinese doc. Already commented at the
> > > > https://issues.apache.org/jira/browse/HUDI-2628 <
> > > > https://issues.apache.org/jira/browse/HUDI-2628>.
> > > > Are there any other volunteers who want to work together to
> translate?
> > > > Please contact me.
> > > >
> > > > > 2021年10月28日 20:35,Vinoth Chandar  写道:
> > > > >
> > > > > Hi all,
> > > > >
> > > > > https://github.com/apache/hudi/pull/3855 puts up a nice redesign
> of
> > > the
> > > > > content, that can show case all of the Hudi capabilities. Please
> > chime
> > > in
> > > > > and help merge the PR.
> > > > >
> > > > > As follow on, we can also fix the Chinese site docs after this?
> > > > >
> > > > > Thanks
> > > > > Vinoth
> > > >
> > > >
> > >
> >
>
>
> --
> Take Care,
> Rajesh Mahindra
>