hudi-bot opened a new issue, #15051: URL: https://github.com/apache/hudi/issues/15051
In query processing, we need to scan many data blocks in HUDI table. However, most of them may not match the query predicate even after using column statistic info in the metadata table, row group level or page level statistics in parquet files, etc. The total data size of touched blocks determines the query speed, and how to save IO has become the key point to improving query performance. To address this problem, we introduce secondary index to improve hudi query performance. In the initial implementation, secondary index based on lucene will be carried out. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-3582 - Type: New Feature - Epic: https://issues.apache.org/jira/browse/HUDI-466 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
