sivabalan narayanan created HUDI-9797:
-----------------------------------------

             Summary: Optimize prepending meta fields with create handle
                 Key: HUDI-9797
                 URL: https://issues.apache.org/jira/browse/HUDI-9797
             Project: Apache Hudi
          Issue Type: Improvement
          Components: writer-core
            Reporter: sivabalan narayanan


Currently, we are re-creating entire AvroRecord in order to prepend meta fields 
in create handles. We should try and see if we can optimize and avoid rewriting 
or re-creating entire record. 

 

[https://github.com/apache/hudi/blob/6ea636078ce1f48e48522185a3e0dba1d22753aa/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/BaseCreateHandle.java#L157]
 

 

[https://github.com/apache/hudi/blob/6ea636078ce1f48e48522185a3e0dba1d22753aa/hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroIndexedRecord.java#L190]



[https://github.com/apache/hudi/blob/6ea636078ce1f48e48522185a3e0dba1d22753aa/hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java#L958]

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to