Re: Questime abou the Payload in Hudi

2019-05-16 Thread Yanjia Li
Hello Vinoth, I could add an example here to clarify this question. We have DF1{id:1, ts: 9} and DF2{id:1, ts:1; id:1, ts:2}. We save DF1 first, then upsert DF2 to DF1. With the default payload, we will have the final result DF{id:1, ts:2}. But we are looking for DF{id:1, ts:9}. If I didn’t

Re: Request to join slack group

2019-05-16 Thread Vinoth Chandar
Glad to have you on board as well! Added you to slack On Wed, May 15, 2019 at 11:09 PM Yanjia Li wrote: > Hello All, > > My name is Gary from Bosch. I am currently working on migrating Hudi to our > current data platform. Glad to join Hudi community. > > May I get an invitation to the Slack

Questime abou the Payload in Hudi

2019-05-16 Thread FIXED-TERM Cheng Yuanbin (CR/PJ-AI-S1)
Hi Hudi, We want to use Apache Hudi for immigrating our data pipeline from batching to incremental. We face several questions about the Hudi. We so appreciate you can help us figure them out. 1. In the default Payload (OverwriteWithLatestAvroPayload), this payload only concern and merge

Request to join slack group

2019-05-16 Thread Yanjia Li
Hello All, My name is Gary from Bosch. I am currently working on migrating Hudi to our current data platform. Glad to join Hudi community. May I get an invitation to the Slack channel? My email is *yanjia.gary...@gmail.com * Thanks, Best Regards, Gary