Re: [ANNOUNCE] Apache Hudi 0.10.0 released

2021-12-13 Thread Vinoth Chandar
Thanks everyone for all the contributions! #OneTeam On Mon, Dec 13, 2021 at 3:58 PM Danny Chan wrote: > The Apache Hudi team is pleased to announce the release of ApacheHudi > 0.10.0. > > Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and > Incrementals. Apache Hudi manages st

[ANNOUNCE] Apache Hudi 0.10.0 released

2021-12-13 Thread Danny Chan
The Apache Hudi team is pleased to announce the release of ApacheHudi 0.10.0. Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals. Apache Hudi manages storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage) and pro

Re: Regular minor/patch releases

2021-12-13 Thread Sivabalan
+1 in general. but yeah, not sure if we have resources to do this for every major release. On Mon, Dec 13, 2021 at 10:01 AM Vinoth Chandar wrote: > Hi all, > > In the past we had plans for minor releases [1], but invariably we end up > doing major ones, which also deliver the bug fixes. > > The

Regular minor/patch releases

2021-12-13 Thread Vinoth Chandar
Hi all, In the past we had plans for minor releases [1], but invariably we end up doing major ones, which also deliver the bug fixes. The reason was the cost involved in doing a release. We have made some good progress towards regression/integration test, which prompts me to revive this. What do

Re: [DISCUSS] Propose Consistent Hashing Indexing for Dynamic Bucket Number

2021-12-13 Thread Vinoth Chandar
+1 on the overall idea. I am wondering if we can layer this on top of Hash Index as a way for just expanding the number of buckets. While Split/Merge sounds great, IMO there is significant operational overhead to it. Most practical scenarios can be met with ability to expand with zero impact as y

Re: [DISCUSS] Propose Consistent Hashing Indexing for Dynamic Bucket Number

2021-12-13 Thread Gary Li
+1, looking forward to the RFC. Best, Gary On Sun, Dec 12, 2021 at 7:12 PM leesf wrote: > +1 for the improvement to make bucket index more comprehensive and looking > forward to the RFC for more details. > > Yuwei Xiao 于2021年12月10日周五 16:22写道: > > > Dear Hudi Community, > > > > I would like to