Re: Implement an asynchronous write commit callback

Thanks for ths +1 Filed : https://issues.apache.org/jira/projects/HUDI/issues/HUDI-1122 > 2020年7月29日 上午8:10，Vinoth Chandar 写道： > > +1 we could support a built in Kafka based notification mechanism.. > Could we keep that in hudi-ut

Re: Implement an asynchronous write commit callback

+1 we could support a built in Kafka based notification mechanism.. Could we keep that in hudi-utilities instead of hudi-client? On Thu, Jul 23, 2020 at 11:18 PM wangxianghu wrote: > Hi Gray > Thanks for reply. It is the latter. We can use the callback to publish > write commit message to extern

Re: Implement an asynchronous write commit callback

Hi Gray Thanks for reply. It is the latter. We can use the callback to publish write commit message to external system. HTTP is the way currently implemented, Kafka is another implementation I’d like to do next. Thanks, Mathieu > 2020年7月24日 上午10:54，Gary Li 写道： > > Hi xianghu, > > Thanks for

Re: Implement an asynchronous write commit callback

Hi xianghu, Thanks for implementing the callback service. That’s very helpful! I am curious what is the difference between the asynchronous mode you are referring to and the existing timeline service. Like, if I am spontaneously looking for the new commit, I can go to the timeline to check if the

Re: Implement an asynchronous write commit callback

+1 as well We can introduce an async mode to provide a pub-sub model so that we can integrate with other systems. Best, Vino 957029...@qq.com <957029...@qq.com> 于2020年7月23日周四 下午9:05写道： > +1. > it's great. > > > > 957029...@qq.com > > From: wangxianghu > Date: 2020-07-23 21:02 > To: dev@hudi.apa

Re: Implement an asynchronous write commit callback

+1. it's great. 957029...@qq.com From: wangxianghu Date: 2020-07-23 21:02 To: dev@hudi.apache.org Subject: Implement an asynchronous write commit callback Hi all, Currently, a write callback service implemented in HTTP has been merged, it will issue an HTTP request to inform downstream that a