This is an automated email from the ASF dual-hosted git repository.
codope pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from febf0c59f38 [HUDI-5769] Ensure partitions created by async indexer are
not deleted by regular writers (#12662)
add 739b79a5b68 [HUDI-8844] Support secondary and expression index
creation through async indexer and write configs (#12653)
No new revisions were added by this update.
Summary of changes:
.../org/apache/hudi/index/HoodieIndexUtils.java | 78 ++++++++++++++
.../metadata/HoodieBackedTableMetadataWriter.java | 39 +++----
.../{functional => }/BaseHoodieIndexClient.java | 38 +------
.../action/index/ScheduleIndexActionExecutor.java | 22 ++--
.../apache/hudi/client/SparkRDDWriteClient.java | 2 +-
.../hudi/{ => index}/HoodieSparkIndexClient.java | 62 ++++-------
.../expression/ExpressionIndexSparkFunctions.java | 2 +-
.../SparkHoodieBackedTableMetadataWriter.java | 2 +-
.../commit/BaseSparkCommitActionExecutor.java | 2 +-
.../apache/hudi/client/TestHoodieSparkIndex.java | 17 +++-
.../hudi/common/config/HoodieIndexingConfig.java | 2 +-
.../hudi/common/config/HoodieMetadataConfig.java | 105 +++++++++++++++++++
.../hudi/common/model/HoodieIndexDefinition.java | 54 +++++++++-
.../hudi/common/table/HoodieTableMetaClient.java | 39 +++----
.../index/expression/HoodieExpressionIndex.java | 1 +
.../hudi/metadata/HoodieTableMetadataUtil.java | 113 ++++++++++++++++++++-
.../hudi/metadata/MetadataPartitionType.java | 71 +++++++++++--
.../hudi/metadata/TestMetadataPartitionType.java | 51 +++++++---
.../common/table/TestHoodieTableMetaClient.java | 9 +-
.../hudi/metadata/TestHoodieTableMetadataUtil.java | 43 +++++++-
.../spark/sql/hudi/command/IndexCommands.scala | 2 +-
.../TestMetadataUtilRLIandSIRecordGeneration.java | 8 +-
.../apache/hudi/functional/TestMORDataSource.scala | 78 +++++++++++++-
.../org/apache/hudi/utilities/HoodieIndexer.java | 9 +-
.../apache/hudi/utilities/TestHoodieIndexer.java | 91 ++++++++++++++---
...perties => indexer-expression-index.properties} | 6 +-
...operties => indexer-secondary-index.properties} | 4 +-
27 files changed, 747 insertions(+), 203 deletions(-)
rename
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/index/{functional
=> }/BaseHoodieIndexClient.java (50%)
rename hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/{ =>
index}/HoodieSparkIndexClient.java (81%)
copy
hudi-utilities/src/test/resources/streamer-config/{indexer-record-index.properties
=> indexer-expression-index.properties} (81%)
copy
hudi-utilities/src/test/resources/streamer-config/{indexer-record-index.properties
=> indexer-secondary-index.properties} (90%)
