Re:[DISCUSS] hudi index improve

+1 on index improvement index optimization is a very valuable thing for hudi Looking forward to the design doc At 2022-04-18 11:18:35, "Forward Xu" wrote: >Hi All, > >I want to improve hudi‘s index. There are four main steps to achieve this > >1. Implement index syntax >a. Implement

Re: [VOTE] Move content off cWiki

+1 - Approve the move > 2021年7月20日 上午8:37，Danny Chan 写道： > > +1 - Approve the move

Re: Welcome New Committers: Pengzhiwei and DannyChan

Congratulations！well deserved ! > 在 2021年7月16日，18:52，vino yang 写道： > > Congratulation

Re: Welcome New Committers: Pengzhiwei and DannyChan

Congratulations! Well deserved! > 2021年7月16日 下午6:52，vino yang 写道： > > Congratulation to both of you! Well deserved! > > Best, > Vino > > leesf mailto:leesf0...@gmail.com>> 于2021年7月16日周五 > 下午6:38写道： > Hi all, > > Please join me in congratulating our newest committers Pengzhiwei and >

Re: [DISCUSS] Improving hudi user experience by providing more ways to configure hudi jobs

sion). > > Best, > Vino > > Pratyaksh Sharma 于2021年5月22日周六 下午8:24写道： > >> +1 from my side. >> >> Introducing new configs based on types definitely improves user experience >> as compared to supplying full class names. We just need to define the enums &

[DISCUSS] Improving hudi user experience by providing more ways to configure hudi jobs

Hi community: Here I want to start a discussion about improving the hudi user experience. Now hudi has more and more users all over the world, but most of them don’t know hudi like uber engineers or us. when they start hudi tasks, they need to do a lot of configuration，many of which are

Re: Welcome new committers and PMC Members!

Congratulations @Gary Li and @Wenning Ding! > 2021年5月12日 上午7:18，Prashant Wason 写道： > > Congratulations Gary and Wenning! > > On Tue, May 11, 2021 at 3:59 PM Raymond Xu > wrote: > >> Big congrats to Gary and Wenning! >> >> On Tue, May 11, 2021 at 1:14 PM vbal...@apache.org >> wrote: >> >>>

Re: [VOTE] Release 0.8.0, release candidate #1

+1（no binding） 1. mvn clean install -DskipTests [OK] 2. Quick start (Spark 2.x scala 2.11) with HDFS [OK] 3. Some unit test in IDEA Thanks, Xianghu At 2021-04-01 15:05:17, "Ding, Wenning" wrote: >+1 > >1. Compilation [OK] >2. Quick start (Spark 2.x, 3.x) with EMR [OK] > >Thanks, >Wenning >

Re:Re: Congrats to our newest committers!

Thanks guys Hudi is really a valuable and promising project， Let's make hudi better together Best wangxianghu At 2021-01-28 10:31:42, "Raymond Xu" wrote: >Congrats, Wang Xianghu and Li Wei! > >On Wed, Jan 27, 2021 at 5:38 PM Gary Li wrote: > >> Congrat

Re: [VOTE] Release 0.7.0, release candidate #2

+1 (not binding) - ran `mvn clean package -DskipTests` [OK] - ran all QuickStart demos (HDFS) [OK] - some unit test locally [OK] - tested flink write client in cluster [OK] Best wangxianghu > 2021年1月25日 下午3:03，vino yang 写道： > > +1 binding > > - ran `mvn clean package -

Re:Re: [DISCUSS] New Flink Writer Proposal

+ 1, Thanks Danny! I believe this new feature OperatorConrdinator in flink-1.11 will help improve the current implementation Best, XianghuWang At 2021-01-05 14:17:37, "vino yang" wrote: >Hi, > >Sharing more details, the OperatorConrdinator is the part of the new Data >Source API(Beta)

Re:Re: [Discussion] Speed up CI/CD build

>screenshots, you'd need to post a link to it. (like via a github gist or >sth) > >On Wed, Dec 23, 2020 at 12:55 AM wangxianghu wrote: > >> Hi Raymond: >> Thanks for asking. Recently, I learned the usage of azure pipeline and >> referred to how Apache Flink does, w

Re: [Discussion] Speed up CI/CD build

you mentioned: https://azure.microsoft.com/en-us/pricing/details/devops/azure-devops-services/ At 2020-12-23 16:09:14, "Raymond Xu" wrote: >Hi @vinoyang @wangxianghu, > >just want to follow up on this work. Any update on the current status? >Particularly, I'm interest

Re: 0.7.0 Release planning

+1 I can assist Danny in this release :) > 2020年12月17日 下午2:08，Danny Chan 写道： > > If no other release managers, i can be the one, although i'm only a > contributor now ~ > > Vinoth Chandar 于2020年12月16日周三 下午12:36写道： > >> Hello all, >> >> We are hoping to cut a release candidate by Dec 31.

Re: 0.7.0 Release planning

+1 I can assist Danny in this release :) > 2020年12月17日 下午2:08，Danny Chan 写道： > > If no other release managers, i can be the one, although i'm only a > contributor now ~ > > Vinoth Chandar 于2020年12月16日周三 下午12:36写道： > >> Hello all, >> >> We are hoping to cut a release candidate by Dec 31.

Re: [DISCUSS] Planning for Releases 0.6.1 and 0.7.0

Hi Rui This article may answer your question：https://docs.google.com/document/d/1bYYPg3OJvAivTCVf9-2hBq1BT6jS7s64lyuMuM4ATV4/edit#heading=h.qn6yq5t0ot50

回复: [DISCUSS] Introduce incremental processing API in Hudi

+1 This will give hudi more capabilities besides data ingestion and writing, and make hudi-based data processing more timely! Best, wangxianghu 发件人: Abhishek Modi 发送时间: 2020年8月31日 15:01 收件人: dev@hudi.apache.org 主题: Re: [DISCUSS] Introduce incremental processing API in Hudi +1 This sounds

回复: 回复： [DISCUSS] Release 0.6.0 timelines

, wangxianghu 发件人: 刘金辉 发送时间: 2020年8月19日 14:06 收件人: dev 主题: 回复： [DISCUSS] Release 0.6.0 timelines hello,vc This week I will devote all of it to it. I do post some problems at the moment, and I will report them to issues later. thanks liujinhui --原始邮件-- 发件人

Re: Implement an asynchronous write commit callback

gt;> >> We can introduce an async mode to provide a pub-sub model so that we can >> integrate with other systems. >> >> Best, >> Vino >> >> 957029...@qq.com <957029...@qq.com> 于2020年7月23日周四 下午9:05写道： >> >>> +1. >>&g

Implement an asynchronous write commit callback

Hi all, Currently, a write callback service implemented in HTTP has been merged, it will issue an HTTP request to inform downstream that a write commit has been executed successfully！User can leverage this notification to do some cascaded incremental processes. But, this implementation is

Re: Multi engine support PR review

Thanks vinoth, I will test it and feedback ASAP > 2020年7月17日 上午10:09，Vinoth Chandar 写道： > > Hello all, > > We have the multi-engine support PR up here > https://github.com/apache/hudi/pull/1827/files > > >

回复: [DISCUSS] Publishing benchmarks for releases

+1 发件人: Mario de Sá Vera 发送时间: 2020年6月22日 14:18 收件人: dev@hudi.apache.org 主题: Re: [DISCUSS] Publishing benchmarks for releases +1 for performance reports On Mon, 22 Jun 2020, 02:41 vino yang, wrote: > +1 as well, > > it would be helpful to measure the performance between different versions. >

Re: [DISCUSS] Introduce a write committed callback hook

+1 for this, I think this is a feature worth doing. Think about it in the filed of offline computing, data changes happens hourly or daily, if there is no a notification mechanism to inform the downstream, then the tasks downstream will keeping running all the day along, but the time really

Re: Apache Hudi Graduation vote on general@incubator

congratulations，great job! 发自我的iPhone > 在 2020年5月23日，05:59，Sivabalan 写道： > > Congrats :) Kudos to Vinoth and the community :) > > >> On Fri, May 22, 2020 at 5:57 PM Mehrotra, Udit >> wrote: >> >> Congrats Vinoth and to this amazing community on a major milestone ! >> >> On 5/22/20,

Re: Apache Hudi Graduation vote on general@incubator

+1(non-binding) 发自我的iPhone > 在 2020年5月16日，10:06，Vinoth Chandar 写道： > > Hello all, > > Just started the VOTE on the IPMC general list [1] > > If you are an IPMC member, you do a *binding *vote > If you are not, you can still do a *non-binding* vote > > Please take a moment to vote. > > [1]

Re: [DISCUSS] Add Github and Twitter Widget on Hudi's official website

Hi vino, That’s a good idea, Adding the Github to Hudi’s official website will make it more convenient to get Hudi's source code, and since Twitter is one of the most popular social tools, It will surely help to strength the influence of Hudi ! Besides, as @tison said he picture is broken, use