pratyakshsharma commented on issue #1591: URL: https://github.com/apache/incubator-hudi/issues/1591#issuecomment-623693070
Hi @AnkitMishra3220 IIUC you want the records to be updated but want to retain the value of the field which has updated value as null. Unfortunately there is no such switch to skip null values on upsert as of now. You can either try to populate default values for fields with null values or try to do some workarounds using transformers (but I feel that will not be a good way :( ). Another way to handle this can be comparing old and new parquet files after every hudi commit, and try to do one round of clean up to suit your use case. But this would need dev cycles from your side. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
