[jira] [Created] (FLINK-33798) Automatically clean up rocksdb logs when the task failover.

2023-12-11 Thread Ming Li (Jira)
Ming Li created FLINK-33798: --- Summary: Automatically clean up rocksdb logs when the task failover. Key: FLINK-33798 URL: https://issues.apache.org/jira/browse/FLINK-33798 Project: Flink Issue

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-07 Thread Ming Li
Congratulations, Weihua! Best, Ming Li Matthias Pohl 于2023年8月7日周一 16:18写道: > Congratulations, Weihua. > > On Mon, Aug 7, 2023 at 3:50 AM Yuepeng Pan wrote: > > > > > > > > > Congratulations, Weihua! > > > > Best, > > Yuepeng Pan &g

[jira] [Created] (FLINK-32698) Add getCheckpointOptions interface in ManagedSnapshotContext

2023-07-26 Thread Ming Li (Jira)
Ming Li created FLINK-32698: --- Summary: Add getCheckpointOptions interface in ManagedSnapshotContext Key: FLINK-32698 URL: https://issues.apache.org/jira/browse/FLINK-32698 Project: Flink Issue

[jira] [Created] (FLINK-32655) RecreateOnResetOperatorCoordinator did not forward notifyCheckpointAborted to the real OperatorCoordinator

2023-07-24 Thread Ming Li (Jira)
Ming Li created FLINK-32655: --- Summary: RecreateOnResetOperatorCoordinator did not forward notifyCheckpointAborted to the real OperatorCoordinator Key: FLINK-32655 URL: https://issues.apache.org/jira/browse/FLINK-32655

[jira] [Created] (FLINK-32001) SupportsRowLevelUpdate does not support returning only a part of the columns.

2023-05-04 Thread Ming Li (Jira)
Ming Li created FLINK-32001: --- Summary: SupportsRowLevelUpdate does not support returning only a part of the columns. Key: FLINK-32001 URL: https://issues.apache.org/jira/browse/FLINK-32001 Project: Flink

[jira] [Created] (FLINK-31474) [Flink] Add failure information for out-of-order checkpoints

2023-03-15 Thread Ming Li (Jira)
Ming Li created FLINK-31474: --- Summary: [Flink] Add failure information for out-of-order checkpoints Key: FLINK-31474 URL: https://issues.apache.org/jira/browse/FLINK-31474 Project: Flink Issue

[jira] [Created] (FLINK-31465) [Flink] Fix shortcode errors in docs

2023-03-15 Thread Ming Li (Jira)
Ming Li created FLINK-31465: --- Summary: [Flink] Fix shortcode errors in docs Key: FLINK-31465 URL: https://issues.apache.org/jira/browse/FLINK-31465 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31462) [Flink] Supports full calculation from the specified snapshot

2023-03-15 Thread Ming Li (Jira)
Ming Li created FLINK-31462: --- Summary: [Flink] Supports full calculation from the specified snapshot Key: FLINK-31462 URL: https://issues.apache.org/jira/browse/FLINK-31462 Project: Flink Issue

[jira] [Created] (FLINK-31364) [Flink] add metrics for TableStore

2023-03-07 Thread Ming Li (Jira)
Ming Li created FLINK-31364: --- Summary: [Flink] add metrics for TableStore Key: FLINK-31364 URL: https://issues.apache.org/jira/browse/FLINK-31364 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31294) CommitterOperator forgot to close Committer when closing.

2023-03-01 Thread ming li (Jira)
ming li created FLINK-31294: --- Summary: CommitterOperator forgot to close Committer when closing. Key: FLINK-31294 URL: https://issues.apache.org/jira/browse/FLINK-31294 Project: Flink Issue Type

[DISCUSS] Whether the snapshot of all OperatorCoordinator should be executed at the beginning of the checkpoint

2023-03-01 Thread Ming Li
o make checkpoint, the max value may have been updated, so is the max value snapshoted by OperatorCoordinator really what this checkpoint should correspond to? Perhaps this example is not appropriate, but it can be really confusing, especially when troubleshooting by querying the state of checkpoints. Thanks

Re: [DISCUSS] SourceCoordinator and ExternallyInducedSourceReader do not work well together

2023-02-27 Thread ming li
a snapshot of OperatorCoordinator immediately. Thanks, Ming Li Becket Qin 于2023年2月28日周二 08:31写道: > Hi Ming, > > I am not sure if I fully understand what you want. It seems what you are > looking for is to have a checkpoint triggered at a customized timing which > aligns wit

[DISCUSS] SourceCoordinator and ExternallyInducedSourceReader do not work well together

2023-02-27 Thread ming li
Hi, dev, We recently used *SourceCoordinator* and *ExternallyInducedSource* to work together on some file type connectors to fulfill some requirements, but we found that these two interfaces do not work well together. *SourceCoordinator* (FLINK-15101) and *ExternallyInducedSource* (FLINK-20270)

[jira] [Created] (FLINK-31008) [Flink][Table Store] The Split allocation of the same bucket in ContinuousFileSplitEnumerator may be out of order

2023-02-09 Thread ming li (Jira)
ming li created FLINK-31008: --- Summary: [Flink][Table Store] The Split allocation of the same bucket in ContinuousFileSplitEnumerator may be out of order Key: FLINK-31008 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-30985) [Flink][table-store] Change the Splits allocation algorithm of ContinuousFileSplitEnumerator in TableStore to a fair algorithm.

2023-02-09 Thread ming li (Jira)
ming li created FLINK-30985: --- Summary: [Flink][table-store] Change the Splits allocation algorithm of ContinuousFileSplitEnumerator in TableStore to a fair algorithm. Key: FLINK-30985 URL: https://issues.apache.org

[jira] [Created] (FLINK-30251) Move the IO with DFS during abort checkpoint to an asynchronous thread.

2022-11-30 Thread ming li (Jira)
ming li created FLINK-30251: --- Summary: Move the IO with DFS during abort checkpoint to an asynchronous thread. Key: FLINK-30251 URL: https://issues.apache.org/jira/browse/FLINK-30251 Project: Flink

[jira] [Created] (FLINK-28390) Allows RocksDB to configure FIFO Compaction to reduce CPU overhead.

2022-07-05 Thread ming li (Jira)
ming li created FLINK-28390: --- Summary: Allows RocksDB to configure FIFO Compaction to reduce CPU overhead. Key: FLINK-28390 URL: https://issues.apache.org/jira/browse/FLINK-28390 Project: Flink

[jira] [Created] (FLINK-28010) Use deleteRange to optimize the clear operation of RocksDBMapState.

2022-06-11 Thread ming li (Jira)
ming li created FLINK-28010: --- Summary: Use deleteRange to optimize the clear operation of RocksDBMapState. Key: FLINK-28010 URL: https://issues.apache.org/jira/browse/FLINK-28010 Project: Flink

[jira] [Created] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2022-05-18 Thread ming li (Jira)
ming li created FLINK-27681: --- Summary: Improve the availability of Flink when the RocksDB file is corrupted. Key: FLINK-27681 URL: https://issues.apache.org/jira/browse/FLINK-27681 Project: Flink

[jira] [Created] (FLINK-24815) Reduce the cpu cost of calculating stateSize during state allocation

2021-11-07 Thread ming li (Jira)
ming li created FLINK-24815: --- Summary: Reduce the cpu cost of calculating stateSize during state allocation Key: FLINK-24815 URL: https://issues.apache.org/jira/browse/FLINK-24815 Project: Flink

[jira] [Created] (FLINK-24086) Do not re-register SharedStateRegistry to reduce the recovery time of the job

2021-08-31 Thread ming li (Jira)
ming li created FLINK-24086: --- Summary: Do not re-register SharedStateRegistry to reduce the recovery time of the job Key: FLINK-24086 URL: https://issues.apache.org/jira/browse/FLINK-24086 Project: Flink

[jira] [Created] (FLINK-21990) Double check Task status when perform checkpoint.

2021-03-26 Thread ming li (Jira)
ming li created FLINK-21990: --- Summary: Double check Task status when perform checkpoint. Key: FLINK-21990 URL: https://issues.apache.org/jira/browse/FLINK-21990 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-20554) The Checkpointed Data Size of the Latest Completed Checkpoint is incorrectly displayed on the Overview page of the UI

2020-12-09 Thread ming li (Jira)
ming li created FLINK-20554: --- Summary: The Checkpointed Data Size of the Latest Completed Checkpoint is incorrectly displayed on the Overview page of the UI Key: FLINK-20554 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-19006) project transformation does not support conversion to Tuple25 type

2020-08-20 Thread ming li (Jira)
ming li created FLINK-19006: --- Summary: project transformation does not support conversion to Tuple25 type Key: FLINK-19006 URL: https://issues.apache.org/jira/browse/FLINK-19006 Project: Flink

[jira] [Created] (FLINK-18808) Task-level numRecordsOut metric may be underestimated

2020-08-03 Thread ming li (Jira)
ming li created FLINK-18808: --- Summary: Task-level numRecordsOut metric may be underestimated Key: FLINK-18808 URL: https://issues.apache.org/jira/browse/FLINK-18808 Project: Flink Issue Type

[jira] [Created] (FLINK-18451) Flink HA on yarn may appear TaskManager double running when HA is restored

2020-06-29 Thread ming li (Jira)
ming li created FLINK-18451: --- Summary: Flink HA on yarn may appear TaskManager double running when HA is restored Key: FLINK-18451 URL: https://issues.apache.org/jira/browse/FLINK-18451 Project: Flink

[jira] [Created] (FLINK-15467) Should wait for the end of the source thread during the Task cancellation

2020-01-03 Thread ming li (Jira)
ming li created FLINK-15467: --- Summary: Should wait for the end of the source thread during the Task cancellation Key: FLINK-15467 URL: https://issues.apache.org/jira/browse/FLINK-15467 Project: Flink

[jira] [Created] (FLINK-14481) Modify the Flink valid socket port check to 0 to 65535.

2019-10-21 Thread ming li (Jira)
ming li created FLINK-14481: --- Summary: Modify the Flink valid socket port check to 0 to 65535. Key: FLINK-14481 URL: https://issues.apache.org/jira/browse/FLINK-14481 Project: Flink Issue Type