sivabalan narayanan created HUDI-6446:
-----------------------------------------

             Summary: Defer Initialization of MDT just at the end of first 
commit 
                 Key: HUDI-6446
                 URL: https://issues.apache.org/jira/browse/HUDI-6446
             Project: Apache Hudi
          Issue Type: Improvement
          Components: metadata
            Reporter: sivabalan narayanan


For a fresh table, when both FILES and RLI is enabled, we use default values 
for num file groups i.e 10 for RLI. and this also creates a log file and does 
not create a base file since there are no records to instantiate as such. So, 
we should defer the instantiation to later. either at the end of first commit 
or when the data table has atleast 1 completed commit. 

For an already existing table, this is not an issue since if there are valid 
records, we will dynamically determine the number of file groups. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to