[GitHub] [hudi] fengjian428 commented on issue #6441: Status on PR: 2666: Support update partial fields for CoW table

2022-08-23 Thread GitBox


fengjian428 commented on issue #6441:
URL: https://github.com/apache/hudi/issues/6441#issuecomment-1225175998

   > What I understand -> OverwriteNonDefaultsWithLatestAvroPayload can update 
the non-null fields in the new data(cdc) to the old data(Hudi table) But what 
if I have multiple changes for the same Record key into new cdc data then it 
won't give me correct output.
   > 
   > For example: Hudi Table: RK1, F1, F2, F3, F4, F5
   > 
   > New cdc data: RK1, null, null, F3', null, F5' RK1, F1', null, F3", null, 
null RK1, null, F2', null, F4', F5"
   > 
   > So Expected output of Record key(RK1) row in Hudi Table would be: RK1, 
F1', F2', F3", F4', F5"
   > 
   > Is there any future plan to merge following work into Hudi master which 
can help us to get partial updates ? #2666
   
   try turn off hoodie.combine.before.upsert?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



[GitHub] [hudi] fengjian428 commented on issue #6441: Status on PR: 2666: Support update partial fields for CoW table

2022-08-21 Thread GitBox


fengjian428 commented on issue #6441:
URL: https://github.com/apache/hudi/issues/6441#issuecomment-1221540522

   Have you tried OverwriteNonDefaultsWithLatestAvroPayload ?  if not, you can 
check whether it can satisfy your requirement or not


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org