[GitHub] [hudi] nsivabalan commented on issue #8576: [SUPPORT] Doubt about handling old data arrival in hudi

2023-04-26 Thread via GitHub 


nsivabalan commented on issue #8576:
URL: https://github.com/apache/hudi/issues/8576#issuecomment-1523546055

   you can also refer to 
https://medium.com/@simpsons/curious-case-of-defaulthoodierecordpayload-vs-default-payload-class-in-hudi-efbfa423c48e
 for some details on these two payloads. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [hudi] nsivabalan commented on issue #8576: [SUPPORT] Doubt about handling old data arrival in hudi

2023-04-26 Thread via GitHub 


nsivabalan commented on issue #8576:
URL: https://github.com/apache/hudi/issues/8576#issuecomment-1523544854

   if you strictly wish to honor the ordering field, you might have to use 
[DefaultHoodieRecordPayload](https://github.com/apache/hudi/blob/c332c60ad7b9e43ebbd09e2eb7c6e53ed7e4a95d/hudi-common/src/main/java/org/apache/hudi/common/model/DefaultHoodieRecordPayload.java)
 
   Out of the box, the payload used is 
[OverwriteWithLatestAvroPayload](https://github.com/apache/hudi/blob/c332c60ad7b9e43ebbd09e2eb7c6e53ed7e4a95d/hudi-common/src/main/java/org/apache/hudi/common/model/OverwriteWithLatestAvroPayload.java)
 
   
   Config to set 
   
https://hudi.apache.org/docs/configurations/#hoodiedatasourcewritepayloadclass 
   Value : org.apache.hudi.common.model.DefaultHoodieRecordPayload


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org