Lsw_aka_laplace created FLINK-19706:
---------------------------------------
Summary: Introduce `Repeated Partition Commit Check` in
`org.apache.flink.table.filesystem.PartitionCommitPolicy`
Key: FLINK-19706
URL: https://issues.apache.org/jira/browse/FLINK-19706
Project: Flink
Issue Type: Improvement
Components: Connectors / FileSystem, Connectors / Hive, Table SQL /
Runtime
Reporter: Lsw_aka_laplace
Hi all,
Recently we have been devoted to using Hive Streaming Writing to
accelerate our data-sync of Data Warehouse based on Hive, and eventually we
made it.
For producing purpose, a lot of metrics/logs/measures were added in
order to help us analyze running info or fix some unexpected problems. Among
these mentioned above, we found that Checking Repeated Partition Commit is the
most important one. So here, we are willing to make a contribution of
introducing this backwards to Community.
If this proposal is meaning, I am happy to introduce my design and
implementation.
Looking forward to ANY opinion~
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
