+1 Will get around to reviewing this more closely this week.
On Mon, Apr 27, 2020 at 11:11 AM Gary Li <[email protected]> wrote: > Hi Wei, > > Thanks for the proposal. +1 from my side. This is definitely a very useful > feature. > > Best Regards, > Gary Li > > > On 4/27/20, 5:16 AM, "wei li" <[email protected]> wrote: > > Currently Hudi only supports sync > dataset metadata to Hive through hive jdbc and IMetaStoreClient. When > you need to sync > to other frameworks, such as aws glue, aliyun DataLake analytics, etc. > You need to copy a lot of code from HoodieHiveClient, which creates a > lot of redundant code. > So need to redesign the hudi-hive-sync module to support > other frameworks and reuse current code as much as possible. Only the > interface is provided by Hudi, and the implement is customized by > different > services as hive 、aws glue、aliyun DataLake analytics. > > I created an RFC with more details > > https://cwiki.apache.org/confluence/display/HUDI/RFC+-+17+Abstract+common+meta+sync+module+support+multiple+meta+service > . Any feedback is appreciated. > > Best Regards, > Wei Li. >
