[jira] [Updated] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner via init Context

[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-35384: --- Summary: Expose TaskIOMetricGroup to custom Partitioner via init Context (was: Expose

[jira] [Comment Edited] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner

[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847116#comment-17847116 ] Steven Zhen Wu edited comment on FLINK-35384 at 5/17/24 12:06 AM: -- one

[jira] [Commented] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner

[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17847116#comment-17847116 ] Steven Zhen Wu commented on FLINK-35384: one potential risk of this type of API is that it is

[jira] [Updated] (FLINK-35384) Expose TaskIOMetricGroup to custom Partitioner

[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-35384: --- Summary: Expose TaskIOMetricGroup to custom Partitioner (was: Expose metrics group to

[jira] [Updated] (FLINK-35384) Expose metrics group to custom Partitioner

[ https://issues.apache.org/jira/browse/FLINK-35384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-35384: --- Description: I am trying to implement a custom range partitioner in the Flink Iceberg sink.

[jira] [Created] (FLINK-35384) Expose metrics group to custom Partitioner

Steven Zhen Wu created FLINK-35384: -- Summary: Expose metrics group to custom Partitioner Key: FLINK-35384 URL: https://issues.apache.org/jira/browse/FLINK-35384 Project: Flink Issue Type:

[jira] [Commented] (FLINK-29801) OperatorCoordinator need open the way to operate metricGroup interface

[ https://issues.apache.org/jira/browse/FLINK-29801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642050#comment-17642050 ] Steven Zhen Wu commented on FLINK-29801: @ruanhang1993 I am not sure if `numEventsIn` is a very

[jira] [Commented] (FLINK-29801) OperatorCoordinator need open the way to operate metricGroup interface

[ https://issues.apache.org/jira/browse/FLINK-29801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640306#comment-17640306 ] Steven Zhen Wu commented on FLINK-29801: This is an important missing part of coordinator. I am

[jira] [Comment Edited] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639718#comment-17639718 ] Steven Zhen Wu edited comment on FLINK-30035 at 11/27/22 10:02 PM: ---

[jira] [Comment Edited] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639718#comment-17639718 ] Steven Zhen Wu edited comment on FLINK-30035 at 11/27/22 8:56 PM: --

[jira] [Comment Edited] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639718#comment-17639718 ] Steven Zhen Wu edited comment on FLINK-30035 at 11/27/22 8:55 PM: --

[jira] [Comment Edited] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639718#comment-17639718 ] Steven Zhen Wu edited comment on FLINK-30035 at 11/27/22 8:55 PM: --

[jira] [Comment Edited] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639718#comment-17639718 ] Steven Zhen Wu edited comment on FLINK-30035 at 11/27/22 8:54 PM: --

[jira] [Comment Edited] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639718#comment-17639718 ] Steven Zhen Wu edited comment on FLINK-30035 at 11/27/22 8:53 PM: --

[jira] [Commented] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17639718#comment-17639718 ] Steven Zhen Wu commented on FLINK-30035: [~fsk119] here are the steps to reproduce. * download

[jira] [Updated] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-30035: --- Description: I used to be able to run the sql-client with iceberg-flink-runtime jar using

[jira] [Created] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

Steven Zhen Wu created FLINK-30035: -- Summary: ./bin/sql-client.sh won't import external jar into the session Key: FLINK-30035 URL: https://issues.apache.org/jira/browse/FLINK-30035 Project: Flink

[jira] [Updated] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-30035: --- Description: I used to be able to run the sql-client with iceberg-flink-runtime jar using

[jira] [Updated] (FLINK-30035) ./bin/sql-client.sh won't import external jar into the session

[ https://issues.apache.org/jira/browse/FLINK-30035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-30035: --- Description: I used to be able to run the sql-client with iceberg-flink-runtime jar using

[jira] [Commented] (FLINK-27405) Refactor SourceCoordinator to abstract BaseCoordinator implementation

[ https://issues.apache.org/jira/browse/FLINK-27405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530078#comment-17530078 ] Steven Zhen Wu commented on FLINK-27405: [~arvid] thanks a lot for the feedbacks. We will create

[jira] [Comment Edited] (FLINK-27405) Refactor SourceCoordinator to abstract BaseCoordinator implementation

[ https://issues.apache.org/jira/browse/FLINK-27405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528443#comment-17528443 ] Steven Zhen Wu edited comment on FLINK-27405 at 4/26/22 10:42 PM: -- cc

[jira] [Commented] (FLINK-27405) Refactor SourceCoordinator to abstract BaseCoordinator implementation

[ https://issues.apache.org/jira/browse/FLINK-27405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528443#comment-17528443 ] Steven Zhen Wu commented on FLINK-27405: cc [~pnowojski] [~dwysakowicz] [~thw] please share your

[jira] [Commented] (FLINK-27255) Flink-avro does not support serialization and deserialization of avro schema longer than 65535 characters

[ https://issues.apache.org/jira/browse/FLINK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522943#comment-17522943 ] Steven Zhen Wu commented on FLINK-27255: [~jinyius] this issue existed for a while now. not sth

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522586#comment-17522586 ] Steven Zhen Wu commented on FLINK-27101: [~pnowojski] Option 3 (externally triggered checkpoint)

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520811#comment-17520811 ] Steven Zhen Wu commented on FLINK-27101: [~yunta] a pluggable checkpoint trigger policy might

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17519060#comment-17519060 ] Steven Zhen Wu commented on FLINK-27101: [~pnowojski] [~yunta] would love to hear your thoughts

[jira] [Updated] (FLINK-27101) Periodically break the chain of incremental checkpoint

[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-27101: --- Description: Incremental checkpoint is almost a must for large-state jobs. It greatly

[jira] [Created] (FLINK-27101) Periodically break the chain of incremental checkpoint

Steven Zhen Wu created FLINK-27101: -- Summary: Periodically break the chain of incremental checkpoint Key: FLINK-27101 URL: https://issues.apache.org/jira/browse/FLINK-27101 Project: Flink

[jira] [Comment Edited] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501576#comment-17501576 ] Steven Zhen Wu edited comment on FLINK-21364 at 3/4/22, 10:56 PM: --

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501576#comment-17501576 ] Steven Zhen Wu commented on FLINK-21364: actually, I think we should look into FLIP-182

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501528#comment-17501528 ] Steven Zhen Wu commented on FLINK-21364: [~jqin] [~thw] [~pnowojski] I like to restart this

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501525#comment-17501525 ] Steven Zhen Wu commented on FLINK-21364: [~pnowojski] sorry for missed you message earlier.

[jira] [Commented] (FLINK-23843) Exceptions during "SplitEnumeratorContext.runInCoordinatorThread()" should cause Global Failure instead of Process Kill

[ https://issues.apache.org/jira/browse/FLINK-23843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17473207#comment-17473207 ] Steven Zhen Wu commented on FLINK-23843: I am not sure what's the right way to fix it. But

[jira] [Comment Edited] (FLINK-23886) An exception is thrown out when recover job timers from checkpoint file

[ https://issues.apache.org/jira/browse/FLINK-23886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418400#comment-17418400 ] Steven Zhen Wu edited comment on FLINK-23886 at 9/22/21, 3:58 PM: -- Just

[jira] [Comment Edited] (FLINK-23886) An exception is thrown out when recover job timers from checkpoint file

[ https://issues.apache.org/jira/browse/FLINK-23886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418400#comment-17418400 ] Steven Zhen Wu edited comment on FLINK-23886 at 9/22/21, 3:58 PM: -- Just

[jira] [Commented] (FLINK-23886) An exception is thrown out when recover job timers from checkpoint file

[ https://issues.apache.org/jira/browse/FLINK-23886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418400#comment-17418400 ] Steven Zhen Wu commented on FLINK-23886: Just to add another data point. We observed the same

[jira] [Closed] (FLINK-10360) support timeout in savepoint REST api

[ https://issues.apache.org/jira/browse/FLINK-10360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu closed FLINK-10360. -- Resolution: Duplicate > support timeout in savepoint REST api >

[jira] [Comment Edited] (FLINK-21513) Rethink up-/down-/restartingTime metrics

[ https://issues.apache.org/jira/browse/FLINK-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329947#comment-17329947 ] Steven Zhen Wu edited comment on FLINK-21513 at 4/27/21, 3:41 AM: --

[jira] [Commented] (FLINK-21513) Rethink up-/down-/restartingTime metrics

[ https://issues.apache.org/jira/browse/FLINK-21513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17329947#comment-17329947 ] Steven Zhen Wu commented on FLINK-21513: [~trohrmann] thanks for tagging me here. Yeah,

[jira] [Comment Edited] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284024#comment-17284024 ] Steven Zhen Wu edited comment on FLINK-21364 at 2/12/21, 10:57 PM: ---

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284024#comment-17284024 ] Steven Zhen Wu commented on FLINK-21364: For pull based source (like file/Iceberg), it is

[jira] [Updated] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-21364: --- Description: For some split assignment strategy, the enumerator/assigner needs to track the

[jira] [Commented] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

[ https://issues.apache.org/jira/browse/FLINK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283152#comment-17283152 ] Steven Zhen Wu commented on FLINK-21364: cc [~sewen] [~jqin] [~thomasWeise] > piggyback

[jira] [Created] (FLINK-21364) piggyback finishedSplitIds in RequestSplitEvent

Steven Zhen Wu created FLINK-21364: -- Summary: piggyback finishedSplitIds in RequestSplitEvent Key: FLINK-21364 URL: https://issues.apache.org/jira/browse/FLINK-21364 Project: Flink Issue

[jira] [Comment Edited] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267590#comment-17267590 ] Steven Zhen Wu edited comment on FLINK-20174 at 1/19/21, 6:59 PM: --

[jira] [Commented] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267590#comment-17267590 ] Steven Zhen Wu commented on FLINK-20174: [~sewen] [~lzljs3620320] Can you take a look if this is

[jira] [Commented] (FLINK-21000) set MetricGroup in SourceCoordinatorContext

[ https://issues.apache.org/jira/browse/FLINK-21000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266679#comment-17266679 ] Steven Zhen Wu commented on FLINK-21000: I tried to trace the code up the chain:

[jira] [Created] (FLINK-21000) set MetricGroup in SourceCoordinatorContext

Steven Zhen Wu created FLINK-21000: -- Summary: set MetricGroup in SourceCoordinatorContext Key: FLINK-21000 URL: https://issues.apache.org/jira/browse/FLINK-21000 Project: Flink Issue Type:

[jira] [Closed] (FLINK-20871) Make DataStream#executeAndCollectWithClient() public

[ https://issues.apache.org/jira/browse/FLINK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu closed FLINK-20871. -- Resolution: Invalid > Make DataStream#executeAndCollectWithClient() public >

[jira] [Updated] (FLINK-20871) Make DataStream#executeAndCollectWithClient() public

[ https://issues.apache.org/jira/browse/FLINK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-20871: --- Description: Right now, `DataStreamUtils#collectWithClient` is marked as deprecated in

[jira] [Updated] (FLINK-20871) Make DataStream#executeAndCollectWithClient() public

[ https://issues.apache.org/jira/browse/FLINK-20871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-20871: --- Summary: Make DataStream#executeAndCollectWithClient() public (was: Make

[jira] [Created] (FLINK-20871) Make DataStream#executeAndCollectWithClient public

Steven Zhen Wu created FLINK-20871: -- Summary: Make DataStream#executeAndCollectWithClient public Key: FLINK-20871 URL: https://issues.apache.org/jira/browse/FLINK-20871 Project: Flink Issue

[jira] [Commented] (FLINK-20575) flink application failed to restore from check-point

[ https://issues.apache.org/jira/browse/FLINK-20575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248056#comment-17248056 ] Steven Zhen Wu commented on FLINK-20575: Just from personal experience. Because this is an

[jira] [Commented] (FLINK-20390) Programmatic access to the back-pressure

[ https://issues.apache.org/jira/browse/FLINK-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239806#comment-17239806 ] Steven Zhen Wu commented on FLINK-20390: not sure what is the input/source. If it is Kafka,

[jira] [Commented] (FLINK-20114) Test Kafka Source based on the new Source API 

[ https://issues.apache.org/jira/browse/FLINK-20114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233762#comment-17233762 ] Steven Zhen Wu commented on FLINK-20114: [~rmetzger] sorry. it might be difficult. We were

[jira] [Comment Edited] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233755#comment-17233755 ] Steven Zhen Wu edited comment on FLINK-20174 at 11/17/20, 5:23 PM: --- I

[jira] [Commented] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233755#comment-17233755 ] Steven Zhen Wu commented on FLINK-20174: I tried the change of setting up InputFiles map for

[jira] [Comment Edited] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233260#comment-17233260 ] Steven Zhen Wu edited comment on FLINK-20174 at 11/17/20, 5:20 AM: ---

[jira] [Commented] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17233260#comment-17233260 ] Steven Zhen Wu commented on FLINK-20174: [~lzljs3620320] thanks a lot for sharing your thoughts.

[jira] [Updated] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-20174: --- Description: Right now, BulkFormat has the generic `SpitT` type extending from

[jira] [Updated] (FLINK-20174) Make BulkFormat more extensible

[ https://issues.apache.org/jira/browse/FLINK-20174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-20174: --- Description: Right now, BulkFormat has the generic `SpitT` type extending from

[jira] [Created] (FLINK-20174) Make BulkFormat more extensible

Steven Zhen Wu created FLINK-20174: -- Summary: Make BulkFormat more extensible Key: FLINK-20174 URL: https://issues.apache.org/jira/browse/FLINK-20174 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-19802) Let BulkFormat createReader and restoreReader methods accept Splits directly

[ https://issues.apache.org/jira/browse/FLINK-19802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228338#comment-17228338 ] Steven Zhen Wu commented on FLINK-19802: [~sewen] sorry, I didn't mean that we need this before

[jira] [Commented] (FLINK-19802) Let BulkFormat createReader and restoreReader methods accept Splits directly

[ https://issues.apache.org/jira/browse/FLINK-19802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227644#comment-17227644 ] Steven Zhen Wu commented on FLINK-19802: [~sewen][~lzljs3620320] to make the `BulkFormat` truly

[jira] [Updated] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.runInCoordinatorThread(Runnable)

[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19934: --- Summary: [FLIP-27 source] add new API:

[jira] [Commented] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226740#comment-17226740 ] Steven Zhen Wu commented on FLINK-19816: [~trohrmann] thanks a lot for taking a look. forwarded

[jira] [Comment Edited] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226460#comment-17226460 ] Steven Zhen Wu edited comment on FLINK-19816 at 11/5/20, 6:10 AM: -- This

[jira] [Comment Edited] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226460#comment-17226460 ] Steven Zhen Wu edited comment on FLINK-19816 at 11/5/20, 3:53 AM: -- This

[jira] [Commented] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226460#comment-17226460 ] Steven Zhen Wu commented on FLINK-19816: This happened again for the same job in production. I

[jira] [Comment Edited] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225572#comment-17225572 ] Steven Zhen Wu edited comment on FLINK-19934 at 11/3/20, 5:46 PM: --

[jira] [Comment Edited] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225572#comment-17225572 ] Steven Zhen Wu edited comment on FLINK-19934 at 11/3/20, 5:43 PM: --

[jira] [Commented] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225572#comment-17225572 ] Steven Zhen Wu commented on FLINK-19934: [~sewen] we thought about that. the difference is that

[jira] [Updated] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

[ https://issues.apache.org/jira/browse/FLINK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19934: --- Description: Here is the motivation use case. We are implementing event-time alignment

[jira] [Created] (FLINK-19934) [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable)

Steven Zhen Wu created FLINK-19934: -- Summary: [FLIP-27 source] add new API: SplitEnumeratorContext.execute(Runnable) Key: FLINK-19934 URL: https://issues.apache.org/jira/browse/FLINK-19934 Project:

[jira] [Updated] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19816: --- Description: h2. Summary Upon failure, it seems that Flink didn't restore from the last

[jira] [Comment Edited] (FLINK-19799) Make FileSource extensible

[ https://issues.apache.org/jira/browse/FLINK-19799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221102#comment-17221102 ] Steven Zhen Wu edited comment on FLINK-19799 at 10/27/20, 3:17 AM: --- We

[jira] [Comment Edited] (FLINK-19799) Make FileSource extensible

[ https://issues.apache.org/jira/browse/FLINK-19799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221102#comment-17221102 ] Steven Zhen Wu edited comment on FLINK-19799 at 10/27/20, 3:17 AM: --- We

[jira] [Commented] (FLINK-19799) Make FileSource extensible

[ https://issues.apache.org/jira/browse/FLINK-19799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221102#comment-17221102 ] Steven Zhen Wu commented on FLINK-19799: We just went through a similar exercise with the

[jira] [Updated] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19816: --- Description: h2. Summary Upon failure, it seems that Flink didn't restore from the last

[jira] [Updated] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

[ https://issues.apache.org/jira/browse/FLINK-19816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19816: --- Description: h2. Summary Upon failure, it seems that Flink didn't restore from the last

[jira] [Created] (FLINK-19816) Flink restored from a wrong checkpoint (a very old one and not the last completed one)

Steven Zhen Wu created FLINK-19816: -- Summary: Flink restored from a wrong checkpoint (a very old one and not the last completed one) Key: FLINK-19816 URL: https://issues.apache.org/jira/browse/FLINK-19816

[jira] [Comment Edited] (FLINK-19698) Add close() method and onCheckpointComplete() to the Source.

[ https://issues.apache.org/jira/browse/FLINK-19698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217111#comment-17217111 ] Steven Zhen Wu edited comment on FLINK-19698 at 10/20/20, 12:59 AM:

[jira] [Commented] (FLINK-18044) Add the subtask index information to the SourceReaderContext.

[ https://issues.apache.org/jira/browse/FLINK-18044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217115#comment-17217115 ] Steven Zhen Wu commented on FLINK-18044: I agree with Stephan that code should avoid explicit

[jira] [Commented] (FLINK-19698) Add close() method and onCheckpointComplete() to the Source.

[ https://issues.apache.org/jira/browse/FLINK-19698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217111#comment-17217111 ] Steven Zhen Wu commented on FLINK-19698: Since FLIP-27 is the unified source interface for both

[jira] [Comment Edited] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208437#comment-17208437 ] Steven Zhen Wu edited comment on FLINK-19401 at 10/6/20, 12:42 AM: ---

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208437#comment-17208437 ] Steven Zhen Wu commented on FLINK-19401: [~roman_khachatryan] I don't know if repeated

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204732#comment-17204732 ] Steven Zhen Wu commented on FLINK-19401: [~trohrmann] just to clarify, do you mean operator

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to excessive checkpoint recoveries which block the JobMaster

[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17204031#comment-17204031 ] Steven Zhen Wu commented on FLINK-19401: [~trohrmann] thanks a lot for looking into the problem.

[jira] [Comment Edited] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203298#comment-17203298 ] Steven Zhen Wu edited comment on FLINK-19401 at 9/29/20, 12:25 AM: ---

[jira] [Commented] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203298#comment-17203298 ] Steven Zhen Wu commented on FLINK-19401: [~trohrmann] emailed you the JM logs with INFO level

[jira] [Updated] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

[ https://issues.apache.org/jira/browse/FLINK-19401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-19401: --- Description: Flink job sometimes got into a restart loop for many hours and can't recover

[jira] [Created] (FLINK-19401) Job stuck in restart loop due to "Could not find registered job manager"

Steven Zhen Wu created FLINK-19401: -- Summary: Job stuck in restart loop due to "Could not find registered job manager" Key: FLINK-19401 URL: https://issues.apache.org/jira/browse/FLINK-19401

[jira] [Commented] (FLINK-19016) Checksum mismatch when restore from RocksDB

[ https://issues.apache.org/jira/browse/FLINK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17199720#comment-17199720 ] Steven Zhen Wu commented on FLINK-19016: [~sewen] we didn't dig deeper and we don't know how to

[jira] [Commented] (FLINK-19016) Checksum mismatch when restore from RocksDB

[ https://issues.apache.org/jira/browse/FLINK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17197779#comment-17197779 ] Steven Zhen Wu commented on FLINK-19016: We have seen a similar problem when the TM disk is

[jira] [Commented] (FLINK-16867) Simplify default timeout configuration

[ https://issues.apache.org/jira/browse/FLINK-16867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164519#comment-17164519 ] Steven Zhen Wu commented on FLINK-16867: I should clarify that web.timeout becomes irrelevant to

[jira] [Commented] (FLINK-16867) Simplify default timeout configuration

[ https://issues.apache.org/jira/browse/FLINK-16867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163667#comment-17163667 ] Steven Zhen Wu commented on FLINK-16867: [~trohrmann] just to follow up on your comment on the

[jira] [Commented] (FLINK-11143) AskTimeoutException is thrown during job submission and completion

[ https://issues.apache.org/jira/browse/FLINK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17162965#comment-17162965 ] Steven Zhen Wu commented on FLINK-11143: [~trohrmann] thanks a lot for looking into it.

[jira] [Updated] (FLINK-18572) Flink web UI doesn't display checkpoint configs like unaligned and tolerable-failed-checkpoints and

[ https://issues.apache.org/jira/browse/FLINK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Zhen Wu updated FLINK-18572: --- Summary: Flink web UI doesn't display checkpoint configs like unaligned and

[jira] [Comment Edited] (FLINK-11143) AskTimeoutException is thrown during job submission and completion

[ https://issues.apache.org/jira/browse/FLINK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156363#comment-17156363 ] Steven Zhen Wu edited comment on FLINK-11143 at 7/14/20, 5:38 PM: --

[jira] [Comment Edited] (FLINK-11143) AskTimeoutException is thrown during job submission and completion

[ https://issues.apache.org/jira/browse/FLINK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156363#comment-17156363 ] Steven Zhen Wu edited comment on FLINK-11143 at 7/14/20, 5:38 PM: --

  1   2   3   >