[jira] [Created] (FLINK-22108) Ephemeral socket address was checkpointed to state and restored back in CollectSinkOperatorCoordinator

2021-04-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-22108: -- Summary: Ephemeral socket address was checkpointed to state and restored back in CollectSinkOperatorCoordinator Key: FLINK-22108 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-21821) StreamTask.cancelables was closed concurrent between task canceler and task thread

2021-03-16 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21821: -- Summary: StreamTask.cancelables was closed concurrent between task canceler and task thread Key: FLINK-21821 URL: https://issues.apache.org/jira/browse/FLINK-21821

[jira] [Created] (FLINK-21817) FLIP-27 Source might break subtask and split assignment upon rescale

2021-03-16 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21817: -- Summary: FLIP-27 Source might break subtask and split assignment upon rescale Key: FLINK-21817 URL: https://issues.apache.org/jira/browse/FLINK-21817 Project: Flink

[jira] [Created] (FLINK-21806) ContinuousEventTimeTrigger should register its first timer base on current watermark

2021-03-15 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21806: -- Summary: ContinuousEventTimeTrigger should register its first timer base on current watermark Key: FLINK-21806 URL: https://issues.apache.org/jira/browse/FLINK-21806

[jira] [Created] (FLINK-21753) Cycle references between memory manager and gc cleaner action

2021-03-12 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21753: -- Summary: Cycle references between memory manager and gc cleaner action Key: FLINK-21753 URL: https://issues.apache.org/jira/browse/FLINK-21753 Project: Flink

[jira] [Created] (FLINK-21635) Driver name is optional for DriverManager.getConnection but a must in JdbcConnectionOptions

2021-03-05 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21635: -- Summary: Driver name is optional for DriverManager.getConnection but a must in JdbcConnectionOptions Key: FLINK-21635 URL: https://issues.apache.org/jira/browse/FLINK-21635

[jira] [Created] (FLINK-21626) Consider shaping newly introduced RuntimeContext.getJobId to return JobID with no Optional wrapper

2021-03-04 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21626: -- Summary: Consider shaping newly introduced RuntimeContext.getJobId to return JobID with no Optional wrapper Key: FLINK-21626 URL: https://issues.apache.org/jira/browse/FLINK-21626

Re: Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-03-04 Thread Kezhu Wang
les` is not part of checkpoint. Checkpoint will complete and persist as before. The changed parts are after checkpoint considered completed. Best, Kezhu Wang On March 4, 2021 at 17:15:53, Piotr Nowojski (pnowoj...@apache.org) wrote: Hi Kezhu, What do you mean by “end-flushing”? I was suggest

Re: Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-03-03 Thread Kezhu Wang
coordinator should be easy. It will definitely complicate currently complex checkpoint coordinator as @Till mentioned in FLINK-21133. Best, Kezhu Wang On March 3, 2021 at 01:09:50, Piotr Nowojski (pnowoj...@apache.org) wrote: Hi, Thanks for reminding me. I think FLIP-147 will have to deal

[jira] [Created] (FLINK-21578) Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition

2021-03-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21578: -- Summary: Closeable Sink Committer/GlobalCommitter were created to function in onestep during job graph composition Key: FLINK-21578 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-21564) CommonTestUtils.waitUntilCondition could fail with condition meets before

2021-03-02 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21564: -- Summary: CommonTestUtils.waitUntilCondition could fail with condition meets before Key: FLINK-21564 URL: https://issues.apache.org/jira/browse/FLINK-21564 Project: Flink

Re: Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-02-28 Thread Kezhu Wang
/flink/commit/1aaa80fb0afad13a314b06783c61c01b9414f91b#diff-d4568b34060bc589cd1354bd125c35aca993dd0c9fe9e4460dfed73501116459R177 Best, Kezhu Wang On February 28, 2021 at 21:23:31, Till Rohrmann (trohrm...@apache.org) wrote: I think you are right with the problem of endOfInput. endOfInput

[jira] [Created] (FLINK-21522) Iterative stream could not work with stop-with-savepoint

2021-02-28 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21522: -- Summary: Iterative stream could not work with stop-with-savepoint Key: FLINK-21522 URL: https://issues.apache.org/jira/browse/FLINK-21522 Project: Flink Issue

Re: Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-02-28 Thread Kezhu Wang
m not wrong. PR#14831: https://github.com/apache/flink/pull/14831 FLINK-21467: https://issues.apache.org/jira/browse/FLINK-21467 Best, Kezhu Wang On February 27, 2021 at 18:12:20, Till Rohrmann (trohrm...@apache.org) wrote: Thanks for all your thoughts. I think we should further think throu

Re: Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-02-25 Thread Kezhu Wang
ait for a specific savepoint For stop-with-savepoint, the checkpoint barrier is already created or received there. Best, Kezhu Wang On February 25, 2021 at 21:02:30, Yun Gao (yungao...@aliyun.com) wrote: Hi all, Very thanks for the discussions! A. Regarding how to avoid emitting reco

Re: Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-02-24 Thread Kezhu Wang
to lose. Then, we could recommend users to migrate possible “end-of-stream-flushing” from “close" to “finish”. Best, Kezhu Wang On February 24, 2021 at 23:47:36, Piotr Nowojski (piotr.nowoj...@gmail.com) wrote: Thanks for the reponses Guowei and Yun, Could you elaborate m

[jira] [Created] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-02-23 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21467: -- Summary: Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times Key: FLINK-21467 URL: https

Re: [ANNOUNCE] Welcome Roman Khachatryan a new Apache Flink Committer

2021-02-10 Thread Kezhu Wang
Congratulations! Best, Kezhu Wang On February 10, 2021 at 21:53:52, Dawid Wysakowicz (dwysakow...@apache.org) wrote: Congratulations Roman! Glad to have you on board! Best, Dawid On 10/02/2021 14:44, Igal Shilman wrote: > Welcome Roman! > Top-notch stuff! :) > > All the

[jira] [Created] (FLINK-21320) Stream from FlinkKafkaShuffle.persistentKeyBy does not end if upstream ends

2021-02-08 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21320: -- Summary: Stream from FlinkKafkaShuffle.persistentKeyBy does not end if upstream ends Key: FLINK-21320 URL: https://issues.apache.org/jira/browse/FLINK-21320 Project

[jira] [Created] (FLINK-21317) Downstream keyed state not work after FlinkKafkaShuffle

2021-02-07 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21317: -- Summary: Downstream keyed state not work after FlinkKafkaShuffle Key: FLINK-21317 URL: https://issues.apache.org/jira/browse/FLINK-21317 Project: Flink Issue

Re: [DISCUSS]FLIP-150: Introduce Hybrid Source

2021-02-04 Thread Kezhu Wang
Hi all, Thanks for starting the discussion! I think there are differences between start-position and checkpoint-state. Checkpoint states are actually intermediate progress-capture in reading data. Source clients don't care about it in coding phase, there are purely implementation details. While

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-03 Thread Kezhu Wang
chaining”. Best, Kezhu Wang On Thu, Feb 4, 2021 at 13:22 Xintong Song wrote: > Hi Kezhu, > > Maybe let me share some backgrounds first. > >- We at Alibaba have been using fine-grained resource management for >many years, with Blink (an internal version of Flink). >

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-03 Thread Kezhu Wang
Hi Till, Based on what I understood, if not wrong, the door is not closed after SSG resource specifying. So, hope it could be useful in potential future improvement. Best, Kezhu Wang On February 3, 2021 at 18:07:21, Till Rohrmann (trohrm...@apache.org) wrote: Thanks for sharing your thoughts

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-03 Thread Kezhu Wang
or development purposes. We might consider to keep that option after the feature is completed, to allow disable the feature without having to touch the job codes. Thank you~ Xintong Song On Wed, Feb 3, 2021 at 1:28 PM Kezhu Wang wrote: > Hi all, sorry for join discussion even after voting s

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-02-02 Thread Kezhu Wang
Hi all, sorry for join discussion even after voting started. I want to share my thoughts on this after reading above discussions. I think Flink *runtime* already has an ideal granularity for resource management 'task'. If there is a slot shared by multiple tasks, that slot's resource requirement

[jira] [Created] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-01-25 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21133: -- Summary: FLIP-27 Source does not work with synchronous savepoint Key: FLINK-21133 URL: https://issues.apache.org/jira/browse/FLINK-21133 Project: Flink Issue

[jira] [Created] (FLINK-21132) BoundedOneInput.endInput is called when taking synchronous savepoint

2021-01-25 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21132: -- Summary: BoundedOneInput.endInput is called when taking synchronous savepoint Key: FLINK-21132 URL: https://issues.apache.org/jira/browse/FLINK-21132 Project: Flink

[jira] [Created] (FLINK-20658) Make sure jdbc connection is established by target driver

2020-12-17 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-20658: -- Summary: Make sure jdbc connection is established by target driver Key: FLINK-20658 URL: https://issues.apache.org/jira/browse/FLINK-20658 Project: Flink Issue

[jira] [Created] (FLINK-20657) Migrate jdbc connection code of JdbcInputFormat, JdbcLookupFunction, JdbcRowDataLookupFunction to SimpleJdbcConnectionProvider

2020-12-17 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-20657: -- Summary: Migrate jdbc connection code of JdbcInputFormat, JdbcLookupFunction, JdbcRowDataLookupFunction to SimpleJdbcConnectionProvider Key: FLINK-20657 URL: https

[jira] [Created] (FLINK-20614) Registered sql drivers not deregistered after task finished in session cluster

2020-12-15 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-20614: -- Summary: Registered sql drivers not deregistered after task finished in session cluster Key: FLINK-20614 URL: https://issues.apache.org/jira/browse/FLINK-20614 Project

[jira] [Created] (FLINK-19717) SourceReaderBase.pollNext may return END_OF_INPUT if SplitReader.fetch throws

2020-10-19 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-19717: -- Summary: SourceReaderBase.pollNext may return END_OF_INPUT if SplitReader.fetch throws Key: FLINK-19717 URL: https://issues.apache.org/jira/browse/FLINK-19717 Project

[jira] [Created] (FLINK-14793) Add SPI interface to discovery state backend and establish well-known names

2019-11-14 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-14793: -- Summary: Add SPI interface to discovery state backend and establish well-known names Key: FLINK-14793 URL: https://issues.apache.org/jira/browse/FLINK-14793 Project

[jira] [Created] (FLINK-14790) Custom state backend in job graph composition without depending on concrete state backend implementation

2019-11-14 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-14790: -- Summary: Custom state backend in job graph composition without depending on concrete state backend implementation Key: FLINK-14790 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-12491) Incorrect documentation for directory path separators of CoreOptions.TMP_DIRS

2019-05-11 Thread Kezhu Wang (JIRA)
Kezhu Wang created FLINK-12491: -- Summary: Incorrect documentation for directory path separators of CoreOptions.TMP_DIRS Key: FLINK-12491 URL: https://issues.apache.org/jira/browse/FLINK-12491 Project

[jira] [Created] (FLINK-11409) Make `ProcessFunction`, `ProcessWindowFunction` and etc. pure interfaces

2019-01-22 Thread Kezhu Wang (JIRA)
Kezhu Wang created FLINK-11409: -- Summary: Make `ProcessFunction`, `ProcessWindowFunction` and etc. pure interfaces Key: FLINK-11409 URL: https://issues.apache.org/jira/browse/FLINK-11409 Project: Flink

Apply for flink contributor permission

2019-01-20 Thread Kezhu Wang
Hi guys: Could someone give me contributor permission? My JIRA username is kezhuw Thanks, Kezhu Wang