Re: [DISCUSS] Bug bash?

2020-04-27 Thread Vinoth Chandar
Great! I will prep the bugs and do uniform assignment across people in this thread :) Sudha (RM for next release), please co-ordinate the timing of this based on the release timeline. if this works well, we can make this a Hudi release tradition :) On Thu, Apr 23, 2020 at 6:45 PM Mehrotra,

[DISCUSS] Readiness for graduation to TLP

2020-04-27 Thread Vinoth Chandar
Hello all, I would like to start a discussion on our readiness to pursue graduation to TLP and potentially follow up with a VOTE with a formal resolution. To seed the discussion, our community's achievements since entering the Incubator in early 2018 include the following: - Accepted > 500

Re: [Discussion] Abstract common meta sync module support multiple meta service

2020-04-27 Thread Vinoth Chandar
+1 Will get around to reviewing this more closely this week. On Mon, Apr 27, 2020 at 11:11 AM Gary Li wrote: > Hi Wei, > > Thanks for the proposal. +1 from my side. This is definitely a very useful > feature. > > Best Regards, > Gary Li > > > On 4/27/20, 5:16 AM, "wei li" wrote: > >

Re: [Discussion] Abstract common meta sync module support multiple meta service

2020-04-27 Thread Gary Li
Hi Wei, Thanks for the proposal. +1 from my side. This is definitely a very useful feature. Best Regards, Gary Li On 4/27/20, 5:16 AM, "wei li" wrote: Currently Hudi only supports sync dataset metadata to Hive through hive jdbc and IMetaStoreClient. When you need to sync

[Discussion] Abstract common meta sync module support multiple meta service

2020-04-27 Thread wei li
Currently Hudi only supports sync dataset metadata to Hive through hive jdbc and IMetaStoreClient. When you need to sync to other frameworks, such as aws glue, aliyun DataLake analytics, etc. You need to copy a lot of code from HoodieHiveClient, which creates a lot of redundant code. So need to