This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 133593a [FLINK-19865] Introduce default log rotation limit for
non-standalone deployments
add 0c7659e [FLINK-19875][table][fs-connector] Integrate file compaction
to filesystem connector
No new revisions were added by this update.
Summary of changes:
.../flink/formats/csv/CsvFileCompactionITCase.java | 12 +-
.../parquet/ParquetFileCompactionITCase.java | 12 +-
.../stream/sql/FileCompactionITCaseBase.java | 148 +++++++++++++
.../runtime/utils/ParallelFiniteTestSource.java | 68 +++---
.../flink/table/filesystem/FileSystemOptions.java | 15 ++
.../table/filesystem/FileSystemTableFactory.java | 3 +
.../table/filesystem/FileSystemTableSink.java | 239 ++++++++++++++++-----
.../filesystem/stream/AbstractStreamingWriter.java | 11 +
.../filesystem/stream/StreamingFileWriter.java | 5 +
.../table/filesystem/stream/StreamingSink.java | 63 ++++++
.../CompactFileWriter.java} | 43 ++--
.../filesystem/stream/compact/CompactOperator.java | 11 +-
...ader.java => FileInputFormatCompactReader.java} | 42 ++--
.../stream/compact/CompactOperatorTest.java | 29 +++
14 files changed, 553 insertions(+), 148 deletions(-)
copy
flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/ShowDatabasesOperation.java
=>
flink-formats/flink-csv/src/test/java/org/apache/flink/formats/csv/CsvFileCompactionITCase.java
(75%)
copy
flink-libraries/flink-state-processing-api/src/test/java/org/apache/flink/state/api/utils/ReduceSum.java
=>
flink-formats/flink-parquet/src/test/java/org/apache/flink/formats/parquet/ParquetFileCompactionITCase.java
(72%)
create mode 100644
flink-table/flink-table-planner-blink/src/test/java/org/apache/flink/table/planner/runtime/stream/sql/FileCompactionITCaseBase.java
copy
flink-test-utils-parent/flink-test-utils/src/main/java/org/apache/flink/streaming/util/FiniteTestSource.java
=>
flink-table/flink-table-planner-blink/src/test/java/org/apache/flink/table/planner/runtime/utils/ParallelFiniteTestSource.java
(57%)
copy
flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/filesystem/stream/{StreamingFileWriter.java
=> compact/CompactFileWriter.java} (52%)
copy
flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/filesystem/stream/compact/{CompactBulkReader.java
=> FileInputFormatCompactReader.java} (56%)
