Re: [VOTE][FLIP-195] Improve the name and structure of vertex and operator name for job

2021-11-25 Thread Yun Gao
+1 (binding). Very thanks Wenlong for the proposal! Best, Yun-- Sender:Xianxun Ye Date:2021/11/24 16:49:44 Recipient:dev@flink.apache.org Theme:[VOTE][FLIP-195] Improve the name and structure of vertex and operator name for job

Re: [DISCUSS] Improve the name and structure of job vertex and operator name for job

2021-11-23 Thread Yun Gao
Hi, Very thanks Wenlong for the update! Also +1 for the proposal~ Best, Yun Gao -- From:Yun Gao Send Time:2021 Nov. 23 (Tue.) 16:09 To:dev Subject:Re: [DISCUSS] Improve the name and structure of job vertex and operator name

Re: [DISCUSS] FLIP-193: Snapshots ownership

2021-11-22 Thread Yun Gao
Hi, Very thanks Dawid for proposing the FLIP to clarify the ownership for the states. +1 for the overall changes since it makes the behavior clear and provide users a determined method to finally cleanup savepoints / retained checkpoints. Regarding the changes to the public interface, it

Re: [DISCUSS] Improve the name and structure of job vertex and operator name for job

2021-11-21 Thread Yun Gao
Hi, Very thanks Wenlong for bringing up this issue and very thanks for the warm discussion! Big +1 to improve the name and structure of job vertex for it make the life of the developers much easier and shorten the operator name would saves a lot of money for reducing the amount of logs to

[jira] [Created] (FLINK-24972) FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout due to failed to complete checkpoint

2021-11-21 Thread Yun Gao (Jira)
Yun Gao created FLINK-24972: --- Summary: FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout due to failed to complete checkpoint Key: FLINK-24972 URL: https://issues.apache.org/jira/browse/FLINK-24972

[jira] [Created] (FLINK-24971) Streaming File Sink s3 end-to-end test stalled on azure

2021-11-21 Thread Yun Gao (Jira)
Yun Gao created FLINK-24971: --- Summary: Streaming File Sink s3 end-to-end test stalled on azure Key: FLINK-24971 URL: https://issues.apache.org/jira/browse/FLINK-24971 Project: Flink Issue Type

[jira] [Created] (FLINK-24970) FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired after 60000 milliseconds while awaiting InitProducerId

2021-11-21 Thread Yun Gao (Jira)
Yun Gao created FLINK-24970: --- Summary: FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired after 6 milliseconds while awaiting InitProducerId Key: FLINK-24970 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-24969) pyflink/table/tests/test_pandas_udf.py hangs on azure

2021-11-21 Thread Yun Gao (Jira)
Yun Gao created FLINK-24969: --- Summary: pyflink/table/tests/test_pandas_udf.py hangs on azure Key: FLINK-24969 URL: https://issues.apache.org/jira/browse/FLINK-24969 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-24968) "Flink over NAT end-to-end test" failed on azure

2021-11-21 Thread Yun Gao (Jira)
Yun Gao created FLINK-24968: --- Summary: "Flink over NAT end-to-end test" failed on azure Key: FLINK-24968 URL: https://issues.apache.org/jira/browse/FLINK-24968 Project: Flink Issue

[jira] [Created] (FLINK-24960) YARNSessionCapacitySchedulerITCase.testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots hang

2021-11-18 Thread Yun Gao (Jira)
Yun Gao created FLINK-24960: --- Summary: YARNSessionCapacitySchedulerITCase.testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots hangs on azure Key: FLINK

[jira] [Created] (FLINK-24949) KafkaITCase.testBigRecordJob fails on azure

2021-11-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-24949: --- Summary: KafkaITCase.testBigRecordJob fails on azure Key: FLINK-24949 URL: https://issues.apache.org/jira/browse/FLINK-24949 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-24946) KafkaSourceLegacyITCase.testBigRecordJob fails on azure

2021-11-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-24946: --- Summary: KafkaSourceLegacyITCase.testBigRecordJob fails on azure Key: FLINK-24946 URL: https://issues.apache.org/jira/browse/FLINK-24946 Project: Flink Issue Type

[jira] [Created] (FLINK-24937) "kubernetes application HA test" hangs on azure

2021-11-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-24937: --- Summary: "kubernetes application HA test" hangs on azure Key: FLINK-24937 URL: https://issues.apache.org/jira/browse/FLINK-24937 Project: Flink Issue

[jira] [Created] (FLINK-24936) Python test_data_stream.py hangs on azure

2021-11-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-24936: --- Summary: Python test_data_stream.py hangs on azure Key: FLINK-24936 URL: https://issues.apache.org/jira/browse/FLINK-24936 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-24935) Python module failed to compile due to "Could not create local repository"

2021-11-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-24935: --- Summary: Python module failed to compile due to "Could not create local repository" Key: FLINK-24935 URL: https://issues.apache.org/jira/browse/FLINK-24935 Proj

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yingjie Cao

2021-11-16 Thread Yun Gao
Congratulations Yingjie! Best, Yun --Original Mail -- Sender:Lijie Wang Send Date:Wed Nov 17 13:22:09 2021 Recipients:Flink Dev Subject:Re: [ANNOUNCE] New Apache Flink Committer - Yingjie Cao Congratulations Yingjie ! Guowei Ma 于2021年11月17日周三 下午12:56写道: >

Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-15 Thread Yun Gao
Congratulations Leonard! Best, Yun -- From:Terry Wang Send Time:2021 Nov. 16 (Tue.) 14:27 To:dev Cc:Dawid Wysakowicz Subject:Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu Congratulations, Leonard Xu! Well deserved!

[jira] [Created] (FLINK-24917) YARNSessionFIFOSecuredITCase hangs on azure

2021-11-15 Thread Yun Gao (Jira)
Yun Gao created FLINK-24917: --- Summary: YARNSessionFIFOSecuredITCase hangs on azure Key: FLINK-24917 URL: https://issues.apache.org/jira/browse/FLINK-24917 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-24916) AvroExternalJarProgramITCase JVM crash on Azure

2021-11-15 Thread Yun Gao (Jira)
Yun Gao created FLINK-24916: --- Summary: AvroExternalJarProgramITCase JVM crash on Azure Key: FLINK-24916 URL: https://issues.apache.org/jira/browse/FLINK-24916 Project: Flink Issue Type: Bug

Re: Re: [ANNOUNCE] New Apache Flink Committer - Jing Zhang

2021-11-15 Thread Yun Gao
Congratulations Jing! Best, Yun --Original Mail -- Sender:Till Rohrmann Send Date:Mon Nov 15 22:20:52 2021 Recipients:dev CC:JING ZHANG Subject:Re: [ANNOUNCE] New Apache Flink Committer - Jing Zhang Congratulations Jing :-) Cheers, Till On Mon, Nov 15,

Re: Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul

2021-11-15 Thread Yun Gao
Congratulations Fabian! Best, Yun --Original Mail -- Sender:Ingo Bürk Send Date:Mon Nov 15 21:27:36 2021 Recipients:dev CC: , Subject:Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul Congratulations, Fabian! On Mon, Nov 15, 2021 at 2:17 PM Arvid Heise

[jira] [Created] (FLINK-24896) Failed to execute goal com.github.siom79.japicmp:japicmp-maven-plugin:0.11.0:cmp (default) on project flink-metrics-core

2021-11-15 Thread Yun Gao (Jira)
Yun Gao created FLINK-24896: --- Summary: Failed to execute goal com.github.siom79.japicmp:japicmp-maven-plugin:0.11.0:cmp (default) on project flink-metrics-core Key: FLINK-24896 URL: https://issues.apache.org/jira

Re: Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-12 Thread Yun Gao
Congratulations Leonard! Best, Yun -- Sender:Zakelly Lan Date:2021/11/12 21:09:48 Recipient: Theme:Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu Congratulations :D Best, Zakelly On Fri, Nov 12, 2021 at 5:03 PM Piotr

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yangze Guo

2021-11-12 Thread Yun Gao
Congratulations Yangze! Best, Yun -- Sender:Piotr Nowojski Date:2021/11/12 17:02:12 Recipient:dev Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yangze Guo Congratulations :) Piotrek pt., 12 lis 2021 o 09:43 Lincoln Lee

[jira] [Created] (FLINK-24853) Report errors if jobs using iteration has runtime mode set to BATCH

2021-11-10 Thread Yun Gao (Jira)
Yun Gao created FLINK-24853: --- Summary: Report errors if jobs using iteration has runtime mode set to BATCH Key: FLINK-24853 URL: https://issues.apache.org/jira/browse/FLINK-24853 Project: Flink

[jira] [Created] (FLINK-24842) Make outputs depends on tails for the iteration body

2021-11-09 Thread Yun Gao (Jira)
Yun Gao created FLINK-24842: --- Summary: Make outputs depends on tails for the iteration body Key: FLINK-24842 URL: https://issues.apache.org/jira/browse/FLINK-24842 Project: Flink Issue Type: Sub

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-08 Thread Yun Gao
Hi all, Very thanks for all the warm discussion! I have no new opinions and only want to clarify some points: @Fabian > from a theoretical point you are right about exposing the DataStream > API in the sink users have the full power to write correct batch and streaming > sinks. I think in

[jira] [Created] (FLINK-24812) compile_cron_python_wheels failed to execute on azure

2021-11-07 Thread Yun Gao (Jira)
Yun Gao created FLINK-24812: --- Summary: compile_cron_python_wheels failed to execute on azure Key: FLINK-24812 URL: https://issues.apache.org/jira/browse/FLINK-24812 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-24811) KafkaSourceITCase#testRedundantParallelism and testBasicRead failed on azure

2021-11-07 Thread Yun Gao (Jira)
Yun Gao created FLINK-24811: --- Summary: KafkaSourceITCase#testRedundantParallelism and testBasicRead failed on azure Key: FLINK-24811 URL: https://issues.apache.org/jira/browse/FLINK-24811 Project: Flink

[jira] [Created] (FLINK-24808) Support IterationListener for per-round operators

2021-11-05 Thread Yun Gao (Jira)
Yun Gao created FLINK-24808: --- Summary: Support IterationListener for per-round operators Key: FLINK-24808 URL: https://issues.apache.org/jira/browse/FLINK-24808 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24807) Fix the issues in checkpoints with iteration

2021-11-05 Thread Yun Gao (Jira)
Yun Gao created FLINK-24807: --- Summary: Fix the issues in checkpoints with iteration Key: FLINK-24807 URL: https://issues.apache.org/jira/browse/FLINK-24807 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24806) RMQSourceITCase.testStopWithSavepoint failed on azure due to connection error

2021-11-05 Thread Yun Gao (Jira)
Yun Gao created FLINK-24806: --- Summary: RMQSourceITCase.testStopWithSavepoint failed on azure due to connection error Key: FLINK-24806 URL: https://issues.apache.org/jira/browse/FLINK-24806 Project: Flink

[jira] [Created] (FLINK-24800) BufferTimeoutITCase.testDisablingBufferTimeout failed on Azure

2021-11-05 Thread Yun Gao (Jira)
Yun Gao created FLINK-24800: --- Summary: BufferTimeoutITCase.testDisablingBufferTimeout failed on Azure Key: FLINK-24800 URL: https://issues.apache.org/jira/browse/FLINK-24800 Project: Flink Issue

Re: Re: [VOTE] FLIP-174: Improve the WithParam interface

2021-11-05 Thread Yun Gao
+1. Very thanks for drafting the FLIP! Best, Yun -- Sender:Becket Qin Date:2021/11/05 18:15:11 Recipient:dev Theme:Re: [VOTE] FLIP-174: Improve the WithParam interface +1. Thanks for the writeup, Dong and Zhipeng. Cheers,

[jira] [Created] (FLINK-24801) "Post-job: Cache Maven local repo" failed on Azure

2021-11-05 Thread Yun Gao (Jira)
Yun Gao created FLINK-24801: --- Summary: "Post-job: Cache Maven local repo" failed on Azure Key: FLINK-24801 URL: https://issues.apache.org/jira/browse/FLINK-24801 Project: Flink Issue

[jira] [Created] (FLINK-24799) KafkaDynamicTableFactoryTest.testTableSourceWithKeyValueAndMetadata fails on Azure

2021-11-05 Thread Yun Gao (Jira)
Yun Gao created FLINK-24799: --- Summary: KafkaDynamicTableFactoryTest.testTableSourceWithKeyValueAndMetadata fails on Azure Key: FLINK-24799 URL: https://issues.apache.org/jira/browse/FLINK-24799 Project

Re: [DISCUSS] FLIP-191: Extend unified Sink interface to support small file compaction

2021-11-04 Thread Yun Gao
Hi all, Very thanks for Fabian drafting the FLIP and the warm discussion! I'd like to complement some points based on the previous discussion: 1. Regarding the case of trans-checkpoints merging I agree with that all the options would not block the current checkpoint that producing the files to

[jira] [Created] (FLINK-24729) Support IterationBody with mixed per-round and all-round operators

2021-11-02 Thread Yun Gao (Jira)
Yun Gao created FLINK-24729: --- Summary: Support IterationBody with mixed per-round and all-round operators Key: FLINK-24729 URL: https://issues.apache.org/jira/browse/FLINK-24729 Project: Flink

[jira] [Created] (FLINK-24722) Only set keyContext for the normal records

2021-11-01 Thread Yun Gao (Jira)
Yun Gao created FLINK-24722: --- Summary: Only set keyContext for the normal records Key: FLINK-24722 URL: https://issues.apache.org/jira/browse/FLINK-24722 Project: Flink Issue Type: Sub-task

Re: [Discuss] Planning Flink 1.15

2021-10-27 Thread Yun Gao
d working on their 1.15. > contribution, we'd like to start the discussion for > the release setup. > > - Release managers: As a team of three seems to have > worked perfectly fine, we'd like to suggest Till, Yun Gao > & Joe as the release managers for 1.15. > > - Timeline: 1.14

[jira] [Created] (FLINK-24655) Support checkpoint for jobs using iteration

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24655: --- Summary: Support checkpoint for jobs using iteration Key: FLINK-24655 URL: https://issues.apache.org/jira/browse/FLINK-24655 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24653) Support per-round operators inside the iteration.

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24653: --- Summary: Support per-round operators inside the iteration. Key: FLINK-24653 URL: https://issues.apache.org/jira/browse/FLINK-24653 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24652) Add operator wrapper for per-round operators

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24652: --- Summary: Add operator wrapper for per-round operators Key: FLINK-24652 URL: https://issues.apache.org/jira/browse/FLINK-24652 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24651) Support bounded all-round iteration

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24651: --- Summary: Support bounded all-round iteration Key: FLINK-24651 URL: https://issues.apache.org/jira/browse/FLINK-24651 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24650) Support unbounded iteration.

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24650: --- Summary: Support unbounded iteration. Key: FLINK-24650 URL: https://issues.apache.org/jira/browse/FLINK-24650 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-24649) Add DraftExecutionEnvironment to support wrapping operators during compile time

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24649: --- Summary: Add DraftExecutionEnvironment to support wrapping operators during compile time Key: FLINK-24649 URL: https://issues.apache.org/jira/browse/FLINK-24649 Project: Flink

[jira] [Created] (FLINK-24646) Add operator wrapper for all-round iterations

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24646: --- Summary: Add operator wrapper for all-round iterations Key: FLINK-24646 URL: https://issues.apache.org/jira/browse/FLINK-24646 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24645) Implements the feedback mechanism and the controller operators

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24645: --- Summary: Implements the feedback mechanism and the controller operators Key: FLINK-24645 URL: https://issues.apache.org/jira/browse/FLINK-24645 Project: Flink Issue

[jira] [Created] (FLINK-24644) Introduce Add broadcast output to broadcast events to all the downstream tasks

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24644: --- Summary: Introduce Add broadcast output to broadcast events to all the downstream tasks Key: FLINK-24644 URL: https://issues.apache.org/jira/browse/FLINK-24644 Project: Flink

[jira] [Created] (FLINK-24643) Introduce the flink-ml-iteration module and iteration api

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24643: --- Summary: Introduce the flink-ml-iteration module and iteration api Key: FLINK-24643 URL: https://issues.apache.org/jira/browse/FLINK-24643 Project: Flink Issue Type

[jira] [Created] (FLINK-24642) Implements unified iteration to support algorithms in flink-ml

2021-10-26 Thread Yun Gao (Jira)
Yun Gao created FLINK-24642: --- Summary: Implements unified iteration to support algorithms in flink-ml Key: FLINK-24642 URL: https://issues.apache.org/jira/browse/FLINK-24642 Project: Flink Issue

[RESULT][VOTE] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

2021-10-26 Thread Yun Gao
Cheers, > >> Till > >> > >> > >> On Fri, Oct 22, 2021 at 6:29 AM Guowei Ma wrote: > >> > >> > +1 (binding) > >> > > >> > Best, > >> > Guowei > >> > > >> > > >> > On Thu,

[VOTE] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

2021-10-21 Thread Yun Gao
Hi all, We would like to start the vote for FLIP-176: Unified Iteration to Support Algorithms (Flink ML) [1]. This FLIP was discussed in this thread [2][3]. The FLIP-176 targets at implementing the iteration API in flink-ml to support the implementation of the algorithms. The vote will be

Re: [DISCUSS] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

2021-10-20 Thread Yun Gao
1506.08603 -- From:David Morávek Send Time:2021 Oct. 4 (Mon.) 14:05 To:dev ; Yun Gao Subject:Re: [DISCUSS] FLIP-176: Unified Iteration to Support Algorithms (Flink ML) Hi Yun, I did a quick pass over the design doc and it add

[jira] [Created] (FLINK-24572) Properly set the context ClassLoader when calling OperatorCoordinator on JM side

2021-10-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-24572: --- Summary: Properly set the context ClassLoader when calling OperatorCoordinator on JM side Key: FLINK-24572 URL: https://issues.apache.org/jira/browse/FLINK-24572 Project

Re: What's the purpose of uniqueId in FileWriterBucket

2021-10-10 Thread Yun Gao
? From: Yun Gao Date: Friday, October 8, 2021 at 22:43 To: wu shaoj , dev@flink.apache.org Subject: Re: What's the purpose of uniqueId in FileWriterBucket Hi Wu, The uid is used to distinguish between the different subtasks, if removed, the different subtasks of the filesink would have name

Re: What's the purpose of uniqueId in FileWriterBucket

2021-10-08 Thread Yun Gao
Hi Wu, The uid is used to distinguish between the different subtasks, if removed, the different subtasks of the filesink would have name conflicts if they writes to the same bucket, thus the uid should be necessary if there are multiple subtasks. Best, Yun --Original Mail

Re: [DISCUSS] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

2021-10-05 Thread Yun Gao
:2021 Oct. 4 (Mon.) 14:05 To:dev ; Yun Gao Subject:Re: [DISCUSS] FLIP-176: Unified Iteration to Support Algorithms (Flink ML) Hi Yun, I did a quick pass over the design doc and it addresses all of the problems with the current iterations I'm aware of. It's great to see that you've been able

Re: [DISCUSS] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

2021-10-03 Thread Yun Gao
Hi all, If we do not have other concerns on this FLIP, we would like to start the voting by the end of oct 8th. Best, Yun. -- From:Yun Gao Send Time:2021 Sep. 15 (Wed.) 20:47 To:dev Subject:[DISCUSS] FLIP-176: Unified

Re: Re: [VOTE] FLIP-173: Support DAG of algorithms

2021-09-19 Thread Yun Gao
Very thanks Dong and Zhipeng for proposing the FLIP on Flink ML! The FLIP looks good to me and +1 from my side, Best, Yun --Original Mail -- Sender:Becket Qin Send Date:Sun Sep 19 12:35:39 2021 Recipients:+dev Subject:Re: [VOTE] FLIP-173: Support DAG of

Re: Re: [VOTE] Release 1.14.0, release candidate #1

2021-09-15 Thread Yun Gao
Hi, The issue FLINK-24300 was noticed on our internal daily TPCDS yesterday evening, we are currently looking at this issue and should approximate the reason, from the current observation it should affect the MultipleInputStreamOperator with chained sources in both stream and batch mode,

[DISCUSS] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

2021-09-15 Thread Yun Gao
Hi all, DongLin, ZhiPeng and I are opening this thread to propose designing and implementing a new iteration library inside the Flink-ML project, as described in FLIP-176[1]. Iteration serves as a fundamental functionality required to support the implementation of ML algorithms. Previously

[jira] [Created] (FLINK-24266) Log improvement for aborting checkpoint due to tasks are finishing

2021-09-13 Thread Yun Gao (Jira)
Yun Gao created FLINK-24266: --- Summary: Log improvement for aborting checkpoint due to tasks are finishing Key: FLINK-24266 URL: https://issues.apache.org/jira/browse/FLINK-24266 Project: Flink

[jira] [Created] (FLINK-24216) org.apache.flink.test.scheduling.AdaptiveSchedulerITCase#testStopWithSavepointFailOnFirstSavepointSucceedOnSecond blocked on azure

2021-09-08 Thread Yun Gao (Jira)
Yun Gao created FLINK-24216: --- Summary: org.apache.flink.test.scheduling.AdaptiveSchedulerITCase#testStopWithSavepointFailOnFirstSavepointSucceedOnSecond blocked on azure Key: FLINK-24216 URL: https://issues.apache.org

[jira] [Created] (FLINK-24140) Enhance the ITCase for FLIP-147

2021-09-03 Thread Yun Gao (Jira)
Yun Gao created FLINK-24140: --- Summary: Enhance the ITCase for FLIP-147 Key: FLINK-24140 URL: https://issues.apache.org/jira/browse/FLINK-24140 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-24068) CheckpointBarrierHandler may skip the markAlignmentStart for alignment -with-timeout checkpoint

2021-08-31 Thread Yun Gao (Jira)
Yun Gao created FLINK-24068: --- Summary: CheckpointBarrierHandler may skip the markAlignmentStart for alignment -with-timeout checkpoint Key: FLINK-24068 URL: https://issues.apache.org/jira/browse/FLINK-24068

[jira] [Created] (FLINK-24067) CheckpointBarrierHandler may skip the markAlignmentStart for alignment -with-timeout checkpoint

2021-08-31 Thread Yun Gao (Jira)
Yun Gao created FLINK-24067: --- Summary: CheckpointBarrierHandler may skip the markAlignmentStart for alignment -with-timeout checkpoint Key: FLINK-24067 URL: https://issues.apache.org/jira/browse/FLINK-24067

[jira] [Created] (FLINK-24065) Upgrade the TwoPhaseCommitSink to support empty transaction after finished

2021-08-31 Thread Yun Gao (Jira)
Yun Gao created FLINK-24065: --- Summary: Upgrade the TwoPhaseCommitSink to support empty transaction after finished Key: FLINK-24065 URL: https://issues.apache.org/jira/browse/FLINK-24065 Project: Flink

[jira] [Created] (FLINK-23970) Future refactoring for the behavior of the tasks marked as finished on recovery

2021-08-25 Thread Yun Gao (Jira)
Yun Gao created FLINK-23970: --- Summary: Future refactoring for the behavior of the tasks marked as finished on recovery Key: FLINK-23970 URL: https://issues.apache.org/jira/browse/FLINK-23970 Project: Flink

[jira] [Created] (FLINK-23938) Do not resume channels if the barrier is received via RPC

2021-08-24 Thread Yun Gao (Jira)
Yun Gao created FLINK-23938: --- Summary: Do not resume channels if the barrier is received via RPC Key: FLINK-23938 URL: https://issues.apache.org/jira/browse/FLINK-23938 Project: Flink Issue Type

[jira] [Created] (FLINK-23884) Fix the concurrent problem between triggering savepoint with drain and finish

2021-08-19 Thread Yun Gao (Jira)
Yun Gao created FLINK-23884: --- Summary: Fix the concurrent problem between triggering savepoint with drain and finish Key: FLINK-23884 URL: https://issues.apache.org/jira/browse/FLINK-23884 Project: Flink

[jira] [Created] (FLINK-23883) Following bug fix and code improvement for FLIP-147

2021-08-19 Thread Yun Gao (Jira)
Yun Gao created FLINK-23883: --- Summary: Following bug fix and code improvement for FLIP-147 Key: FLINK-23883 URL: https://issues.apache.org/jira/browse/FLINK-23883 Project: Flink Issue Type

Re: Re: [DISCUSS] Merge the Last Piece of FLIP-147 After Code Freeze

2021-08-19 Thread Yun Gao
Very thanks @Xintong and everyone! I'll merge the remaining PRs~ Very sorry for the inconvinient brought. Best, Yun --Original Mail -- Sender:Xintong Song Send Date:Fri Aug 20 09:43:24 2021 Recipients:dev , Yun Gao Subject:Re: [DISCUSS] Merge the Last Piece

[DISCUSS] Merge the Last Piece of FLIP-147 After Code Freeze

2021-08-17 Thread Yun Gao
Hi all, Since Flink 1.14 is already code freeze, but for FLIP-147 we still have the last piece of work left, thus we would like to start a discussion about merging them after code freeze. Currently there are two non-bug-fix issues left and since 1. FLINK-23512: The PR is in fact approved

[jira] [Created] (FLINK-23831) Verify the final checkpoint and stop-with-savepoint --drain

2021-08-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-23831: --- Summary: Verify the final checkpoint and stop-with-savepoint --drain Key: FLINK-23831 URL: https://issues.apache.org/jira/browse/FLINK-23831 Project: Flink Issue

[jira] [Created] (FLINK-23815) Follow-up code improvement regarding final checkpoint.

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23815: --- Summary: Follow-up code improvement regarding final checkpoint. Key: FLINK-23815 URL: https://issues.apache.org/jira/browse/FLINK-23815 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23809: --- Summary: Respect the finished flag when extracting operator states due to skip in-flight data Key: FLINK-23809 URL: https://issues.apache.org/jira/browse/FLINK-23809 Project

[jira] [Created] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23808: --- Summary: Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks Key: FLINK-23808 URL: https://issues.apache.org/jira/browse/FLINK-23808 Project

[jira] [Created] (FLINK-23681) Rename the field name of OperatorIDPair to avoid the confusion

2021-08-08 Thread Yun Gao (Jira)
Yun Gao created FLINK-23681: --- Summary: Rename the field name of OperatorIDPair to avoid the confusion Key: FLINK-23681 URL: https://issues.apache.org/jira/browse/FLINK-23681 Project: Flink Issue

[jira] [Created] (FLINK-23512) Check for illegal modifications of JobGraph with partially finished operators

2021-07-27 Thread Yun Gao (Jira)
Yun Gao created FLINK-23512: --- Summary: Check for illegal modifications of JobGraph with partially finished operators Key: FLINK-23512 URL: https://issues.apache.org/jira/browse/FLINK-23512 Project: Flink

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-22 Thread Yun Gao
have no other missing points for the design and FLIP~ Best, Yun -- From:Till Rohrmann Send Time:2021 Jul. 22 (Thu.) 17:57 To:Yun Gao Cc:Piotr Nowojski ; dev ; Yun Gao ; Piotr Nowojski Subject:Re: [RESULT][VOTE] FLIP-147: Support

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-22 Thread Yun Gao
jski Send Time:2021 Jul. 22 (Thu.) 15:33 To:dev ; Yun Gao Cc:Till Rohrmann ; Yun Gao ; Piotr Nowojski Subject:Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished Hi Guowei, > Thank Dawid and Piotr for sharing the problem. +1 to EndInput/Finish can > becalled repeat

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-22 Thread Yun Gao
-- From:Piotr Nowojski Send Time:2021 Jul. 22 (Thu.) 02:46 To:dev Cc:Yun Gao ; Till Rohrmann ; Yun Gao ; Piotr Nowojski Subject:Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished Hi Steven, > I probably missed sth h

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-19 Thread Yun Gao
Wysakowicz Send Time:2021 Jul. 19 (Mon.) 17:51 To:dev ; Till Rohrmann Cc:Yun Gao ; Yun Gao Subject:Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished Small correction. I meant we need to adjust the EndOfInputEvent of course. Best, Dawid On 19/07/2021 11:48, Dawid Wysakowicz wrote

Re: Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-19 Thread Yun Gao
userFunction).requiresFinalCheckpoint(); } } I think we should still keep the change ? Best, Yun --Original Mail -- Sender:Dawid Wysakowicz Send Date:Sun Jul 18 18:44:50 2021 Recipients:Flink Dev , Yun Gao Subject:Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Task

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-16 Thread Yun Gao
ne that says that you have to wait for a checkpoint if you want to stop. It just happens that in the case of stop-with-savepoint the next checkpoint will be a savepoint. That way we decouple the lifecycle management and the stop-with-savepoint operations a bit better. Cheers, Till On Fri, Jul 16, 2021 at

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-16 Thread Yun Gao
me endOfInputEvent from the StreamTask, then we might actually send MAX_WATERMARK multiple times. I think what I am lacking a bit is how the StreamOperator lifecycle will fit together with the lifecycle of its owner and the corresponding signals we have to send. Cheers, Till Cheers, Till On

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-16 Thread Yun Gao
15, 2021 at 10:15 AM Till Rohrmann > wrote: > > > Thanks a lot for your answers and clarifications Yun. > > > > 1+2) Agreed, this can be a future improvement if this becomes a problem. > > > > 3) Great, this will help a lot with understanding the FLIP

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-16 Thread Yun Gao
hu, Jul 15, 2021 at 10:15 AM Till Rohrmann wrote: > Thanks a lot for your answers and clarifications Yun. > > 1+2) Agreed, this can be a future improvement if this becomes a problem. > > 3) Great, this will help a lot with understanding the FLIP. > > Cheers, > Till

Re: [RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-14 Thread Yun Gao
ers, Till On Fri, Jul 2, 2021 at 8:36 AM Yun Gao wrote: > Hi there, > > Since the voting time of FLIP-147[1] has passed, I'm closing the vote now. > > There were seven +1 votes ( 6 / 7 are bindings) and no -1 votes: > > - Dawid Wysakowicz (binding) > - Piotr Nowojski(binding

[jira] [Created] (FLINK-23366) AkkaRpcActorTest. testOnStopFutureCompletionDirectlyTerminatesAkkaRpcActor fails on azure

2021-07-12 Thread Yun Gao (Jira)
Yun Gao created FLINK-23366: --- Summary: AkkaRpcActorTest. testOnStopFutureCompletionDirectlyTerminatesAkkaRpcActor fails on azure Key: FLINK-23366 URL: https://issues.apache.org/jira/browse/FLINK-23366

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yuan Mei

2021-07-07 Thread Yun Gao
Congratulations Yuan! Best, Yun --Original Mail -- Sender:Zhilong Hong Send Date:Thu Jul 8 10:50:36 2021 Recipients:dev (dev@flink.apache.org) Subject:Re: [ANNOUNCE] New Apache Flink Committer - Yuan Mei Congratulations, Yuan! Best, Zhilong On Thu, Jul 8,

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Yun Gao
Congratulations Yang! Best, Yun -- Sender:Jark Wu Date:2021/07/07 10:20:27 Recipient:dev Cc:Yang Wang; Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang Congratulations Yang Wang! Best, Jark On Wed, 7 Jul 2021 at

Re: Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Yun Gao
Congratulations Guowei! Best, Yun -- Sender:JING ZHANG Date:2021/07/07 10:33:51 Recipient:dev Theme:Re: [ANNOUNCE] New PMC member: Guowei Ma Congratulations, Guowei Ma! Best regards, JING ZHANG Zakelly Lan 于2021年7月7日周三

[jira] [Created] (FLINK-23223) When flushAlways is enabled the subpartition may lose notification of data availability

2021-07-02 Thread Yun Gao (Jira)
Yun Gao created FLINK-23223: --- Summary: When flushAlways is enabled the subpartition may lose notification of data availability Key: FLINK-23223 URL: https://issues.apache.org/jira/browse/FLINK-23223

[RESULT][VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-07-02 Thread Yun Gao
Hi there, Since the voting time of FLIP-147[1] has passed, I'm closing the vote now. There were seven +1 votes ( 6 / 7 are bindings) and no -1 votes: - Dawid Wysakowicz (binding) - Piotr Nowojski(binding) - Jiangang Liu (binding) - Arvid Heise (binding) - Jing Zhang (binding) - Leonard Xu

[VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-06-28 Thread Yun Gao
Hi all, For FLIP-147[1] which targets at supports checkpoints after tasks finished and modify operator API and implementation to ensures the commit of last piece of data, since after the last vote we have more discussions[2][3] and a few updates, including changes to PublicEvolving API, I'd

[jira] [Created] (FLINK-23159) Correlated sql subquery on the source created via fromValues() failed to compile

2021-06-25 Thread Yun Gao (Jira)
Yun Gao created FLINK-23159: --- Summary: Correlated sql subquery on the source created via fromValues() failed to compile Key: FLINK-23159 URL: https://issues.apache.org/jira/browse/FLINK-23159 Project

[jira] [Created] (FLINK-23158) Source transformation is not added to the StreamExecutionEnvironment explicitly

2021-06-25 Thread Yun Gao (Jira)
Yun Gao created FLINK-23158: --- Summary: Source transformation is not added to the StreamExecutionEnvironment explicitly Key: FLINK-23158 URL: https://issues.apache.org/jira/browse/FLINK-23158 Project: Flink

[jira] [Created] (FLINK-23021) Check if the restarted job topology is consistent on restart

2021-06-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-23021: --- Summary: Check if the restarted job topology is consistent on restart Key: FLINK-23021 URL: https://issues.apache.org/jira/browse/FLINK-23021 Project: Flink Issue

<    1   2   3   4   5   6   >