This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 6ffedcc9b2b0 fix: Handle ArrayIndexOutOfBoundException for
non-partitioned datasets (#17933)
add c33bd966e995 feat: support mini batch split reader (#17872)
No new revisions were added by this update.
Summary of changes:
.../apache/hudi/configuration/FlinkOptions.java | 7 +
.../source/reader/DefaultHoodieBatchReader.java | 112 +++++
...tReaderFunction.java => HoodieBatchReader.java} | 22 +-
.../{BatchRecords.java => HoodieBatchRecords.java} | 30 +-
.../source/reader/HoodieSourceSplitReader.java | 43 +-
.../function/MergeOnReadSplitReaderFunction.java | 15 +-
.../reader/function/SplitReaderFunction.java | 3 +-
.../apache/hudi/source/reader/TestBatchReader.java | 334 ++++++++++++++
.../hudi/source/reader/TestBatchRecords.java | 146 +-----
.../hudi/source/reader/TestDefaultBatchReader.java | 511 +++++++++++++++++++++
.../source/reader/TestHoodieSourceSplitReader.java | 337 ++++++++------
.../TestMergeOnReadSplitReaderFunction.java | 52 +++
12 files changed, 1283 insertions(+), 329 deletions(-)
create mode 100644
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/reader/DefaultHoodieBatchReader.java
copy
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/reader/{function/SplitReaderFunction.java
=> HoodieBatchReader.java} (61%)
rename
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/source/reader/{BatchRecords.java
=> HoodieBatchRecords.java} (78%)
create mode 100644
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/source/reader/TestBatchReader.java
create mode 100644
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/source/reader/TestDefaultBatchReader.java
