prashantwason opened a new pull request, #9106: URL: https://github.com/apache/hudi/pull/9106
[HUDI-6118] Some fixes to improve the MDT and record index code base. ### Change Logs 1. Print MDT partition name instead of the enum tostring in logs 2. Use fsView.loadAllPartitions() 3. When publishing size metrics for MDT, only consider partitions which have been initialized 4. Fixed job status names 5. Limited logs which were printing the entire list of partitions. This is very verbose for datasets with large number of partitions 6. Added a config to reduce the max parallelism of record index initialization. 7. Changed defaults for MDT write configs to reasonable values 8. Added config for MDT logBlock size. Larger blocks are preferred to reduce lookup time. 9. Fixed the size metrics for MDT. These metrics should be set instead of incremented. ### Impact Fixes issues for the recently commited RI and MDT changes ### Risk level (write none, low medium or high below) Low ### Documentation Update None ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
