[jira] [Created] (FLINK-28088) Adjust table store document to catalog

2022-06-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28088: Summary: Adjust table store document to catalog Key: FLINK-28088 URL: https://issues.apache.org/jira/browse/FLINK-28088 Project: Flink Issue Type: Improvemen

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-15 Thread Xintong Song
My impression of JobResultStore is more about fault tolerance and high availability. Using it for providing information to users sounds worth exploring. We probably need more time to think it through. Given that it doesn't conflict with what we have proposed in this FLIP, I'd suggest considering i

Re: [DISCUSS] Dockerimage + Helm chart only patch releases for the Kubernetes operator

2022-06-15 Thread Yang Wang
>From what I have learned from the last 1.0.0 release, I think it is not too complicated and a big burden for flink-kubernetes-operator patch releases. The major bottleneck might be the VOTE duration(e.g. jet lag, the weekend). We almost need one week for the release after all the blockers are reso

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Yuan Mei
Congrats, Jingsong! Best, Yuan On Thu, Jun 16, 2022 at 11:31 AM Yang Wang wrote: > Congrats, Jingsong! > > Best, > Yang > > Zakelly Lan 于2022年6月16日周四 11:16写道: > > > Congrats & well deserved! > > > > Best, > > Zakelly > > > > On Thu, Jun 16, 2022 at 10:36 AM Guowei Ma wrote: > > > > > Congrats

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-15 Thread Yang Wang
This is a very useful feature both for finished streaming and batch jobs. Except for the WebUI & REST API improvements, I am curious whether we could also integrate some critical information(e.g. latest checkpoint) into the job result store[1]. I am just feeling this is also somehow related with "

[jira] [Created] (FLINK-28087) FlinkDeployment name validation

2022-06-15 Thread Fred k (Jira)
Fred k created FLINK-28087: -- Summary: FlinkDeployment name validation Key: FLINK-28087 URL: https://issues.apache.org/jira/browse/FLINK-28087 Project: Flink Issue Type: Improvement Compone

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Yang Wang
Congrats, Jingsong! Best, Yang Zakelly Lan 于2022年6月16日周四 11:16写道: > Congrats & well deserved! > > Best, > Zakelly > > On Thu, Jun 16, 2022 at 10:36 AM Guowei Ma wrote: > > > Congrats, Jingsong! > > > > Best, > > Guowei > > > > > > On Thu, Jun 16, 2022 at 9:49 AM Hangxiang Yu > wrote: > > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Zakelly Lan
Congrats & well deserved! Best, Zakelly On Thu, Jun 16, 2022 at 10:36 AM Guowei Ma wrote: > Congrats, Jingsong! > > Best, > Guowei > > > On Thu, Jun 16, 2022 at 9:49 AM Hangxiang Yu wrote: > > > Congrats, Jingsong! > > > > Best, > > Hangxiang > > > > On Thu, Jun 16, 2022 at 9:46 AM Aitozi wro

[jira] [Created] (FLINK-28086) Table Store Catalog supports partition methods

2022-06-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28086: Summary: Table Store Catalog supports partition methods Key: FLINK-28086 URL: https://issues.apache.org/jira/browse/FLINK-28086 Project: Flink Issue Type: Ne

Re: Contributing to Apache Flink

2022-06-15 Thread Shubham Bansal
Gentle reminder!! On Sat, May 21, 2022 at 7:34 PM Shubham Bansal wrote: > Hi Everyone, > > I have been looking at some starter tagged JIRA in the last couple of > weeks. > > https://issues.apache.org/jira/browse/FLINK-27506 > https://issues.apache.org/jira/browse/FLINK-27508 > https://issues.apa

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Guowei Ma
Congrats, Jingsong! Best, Guowei On Thu, Jun 16, 2022 at 9:49 AM Hangxiang Yu wrote: > Congrats, Jingsong! > > Best, > Hangxiang > > On Thu, Jun 16, 2022 at 9:46 AM Aitozi wrote: > > > Congrats, Jingsong! > > > > Best, > > Aitozi > > > > Zhuoluo Yang 于2022年6月16日周四 09:26写道: > > > > > Many con

About the Current22 event

2022-06-15 Thread Becket Qin
Hi my Flink fellas, The CFP for the Current22 [1] event is about to close. The Current event is the next generation of KafkaSummit. It expands the scope to cover **ALL** the technologies for real-time data, not limited to Kafka. Given Flink is a leading project in this area, the program committee

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Hangxiang Yu
Congrats, Jingsong! Best, Hangxiang On Thu, Jun 16, 2022 at 9:46 AM Aitozi wrote: > Congrats, Jingsong! > > Best, > Aitozi > > Zhuoluo Yang 于2022年6月16日周四 09:26写道: > > > Many congratulations to teacher Lee! > > > > Thanks, > > Zhuoluo > > > > > > Dian Fu 于2022年6月16日周四 08:54写道: > > > > > Congra

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Aitozi
Congrats, Jingsong! Best, Aitozi Zhuoluo Yang 于2022年6月16日周四 09:26写道: > Many congratulations to teacher Lee! > > Thanks, > Zhuoluo > > > Dian Fu 于2022年6月16日周四 08:54写道: > > > Congratulations, Jingsong! > > > > Regards, > > Dian > > > > On Thu, Jun 16, 2022 at 1:08 AM Yu Li wrote: > > > > > Cong

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Zhuoluo Yang
Many congratulations to teacher Lee! Thanks, Zhuoluo Dian Fu 于2022年6月16日周四 08:54写道: > Congratulations, Jingsong! > > Regards, > Dian > > On Thu, Jun 16, 2022 at 1:08 AM Yu Li wrote: > > > Congrats, Jingsong! > > > > Best Regards, > > Yu > > > > > > On Wed, 15 Jun 2022 at 15:26, Sergey Nuyanzi

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Shengkai Fang
Congratulations, Jingsong! Best, Shengkai Dian Fu 于2022年6月16日周四 08:54写道: > Congratulations, Jingsong! > > Regards, > Dian > > On Thu, Jun 16, 2022 at 1:08 AM Yu Li wrote: > > > Congrats, Jingsong! > > > > Best Regards, > > Yu > > > > > > On Wed, 15 Jun 2022 at 15:26, Sergey Nuyanzin > wrote:

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Dian Fu
Congratulations, Jingsong! Regards, Dian On Thu, Jun 16, 2022 at 1:08 AM Yu Li wrote: > Congrats, Jingsong! > > Best Regards, > Yu > > > On Wed, 15 Jun 2022 at 15:26, Sergey Nuyanzin wrote: > > > Congratulations, Jingsong! > > > > On Wed, Jun 15, 2022 at 8:45 AM Jingsong Li > > wrote: > > > >

[jira] [Created] (FLINK-28085) Close all the pending Pulsar transactions when flink shutdown the pipeline.

2022-06-15 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-28085: --- Summary: Close all the pending Pulsar transactions when flink shutdown the pipeline. Key: FLINK-28085 URL: https://issues.apache.org/jira/browse/FLINK-28085 Project: Fl

[jira] [Created] (FLINK-28084) Pulsar unordered reader should disable retry and delete reconsume logic.

2022-06-15 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-28084: --- Summary: Pulsar unordered reader should disable retry and delete reconsume logic. Key: FLINK-28084 URL: https://issues.apache.org/jira/browse/FLINK-28084 Project: Flink

Re: Re: [DISCUSS] FLIP-240: Introduce "ANALYZE TABLE" Syntax

2022-06-15 Thread Jing Ge
Hi Godfrey, Thanks for driving this! There are some areas where I couldn't find enough information in the FLIP, just wondering if I could get more explanation from you w.r.t. the following questions: 1. When will the converted SELECT statement of the ANALYZE TABLE be submitted? right after the CR

Re: [DISCUSS] Deprecate SourceFunction APIs

2022-06-15 Thread Alexander Fedulov
Thank you all for your valuable input and participation in the discussion The vote is open now [1] [1] https://lists.apache.org/thread/kv9rj3w2rmkb8jtss5bqffhw57or7v8v Best, Alexander Fedulov On Tue, Jun 14, 2022 at 10:21 PM Jing Ge wrote: > Hi Martijn, > > Yes, that is exactly what I trie

[jira] [Created] (FLINK-28083) PulsarSource cannot work with object-reusing DeserializationSchema.

2022-06-15 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-28083: --- Summary: PulsarSource cannot work with object-reusing DeserializationSchema. Key: FLINK-28083 URL: https://issues.apache.org/jira/browse/FLINK-28083 Project: Flink

[VOTE] Deprecate SourceFunction API

2022-06-15 Thread Alexander Fedulov
Hi everyone, following the discussion in [1], I would like to open up a vote for deprecating the SourceFunction API. An overview of the steps required for being able to drop this API in the next major version is maintained in the umbrella FLINK-28045 ticket [2]. This proposition implies marking

[jira] [Created] (FLINK-28082) Support end to end encryption on Pulsar connector.

2022-06-15 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-28082: --- Summary: Support end to end encryption on Pulsar connector. Key: FLINK-28082 URL: https://issues.apache.org/jira/browse/FLINK-28082 Project: Flink Issue Type:

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Yu Li
Congrats, Jingsong! Best Regards, Yu On Wed, 15 Jun 2022 at 15:26, Sergey Nuyanzin wrote: > Congratulations, Jingsong! > > On Wed, Jun 15, 2022 at 8:45 AM Jingsong Li > wrote: > > > Thanks everyone. > > > > It's great to be with you in the Flink community! > > > > Best, > > Jingsong > > > > O

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-06-15 Thread Peter Huang
+1 On Wed, Jun 15, 2022 at 2:55 AM Xintong Song wrote: > +1 (binding) > > Best, > > Xintong > > > > On Wed, Jun 15, 2022 at 5:30 PM Jiangang Liu > wrote: > > > +1 > > > > Chesnay Schepler 于2022年6月15日周三 17:15写道: > > > > > +1 > > > > > > On 15/06/2022 10:49, Lijie Wang wrote: > > > > Hi everyone

[jira] [Created] (FLINK-28081) Remove deprecated Hadoop specific Flink configuration options

2022-06-15 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-28081: - Summary: Remove deprecated Hadoop specific Flink configuration options Key: FLINK-28081 URL: https://issues.apache.org/jira/browse/FLINK-28081 Project: Flink

[jira] [Created] (FLINK-28080) Introduce MutableURLClassLoader as parent class of FlinkUserClassLoader and SafetyNetWrapperClassLoader

2022-06-15 Thread dalongliu (Jira)
dalongliu created FLINK-28080: - Summary: Introduce MutableURLClassLoader as parent class of FlinkUserClassLoader and SafetyNetWrapperClassLoader Key: FLINK-28080 URL: https://issues.apache.org/jira/browse/FLINK-28080

Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-06-15 Thread Feifan Wang
Thanks for bringing this up. Strongly +1 —— Name: Feifan Wang Email: zoltar9...@163.com Replied Message | From | Yuan Mei | | Date | 06/15/2022 11:41 | | To | dev , | | Subject | Re: [DISCUSS ] Make state.backend.incremental as true by default | Thanks for bringing this

[jira] [Created] (FLINK-28079) Check Hive DDL against table store schema when creating table

2022-06-15 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28079: --- Summary: Check Hive DDL against table store schema when creating table Key: FLINK-28079 URL: https://issues.apache.org/jira/browse/FLINK-28079 Project: Flink

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-06-15 Thread Xintong Song
+1 (binding) Best, Xintong On Wed, Jun 15, 2022 at 5:30 PM Jiangang Liu wrote: > +1 > > Chesnay Schepler 于2022年6月15日周三 17:15写道: > > > +1 > > > > On 15/06/2022 10:49, Lijie Wang wrote: > > > Hi everyone, > > > > > > We've received some additional concerns since the last vote [1], and > > > t

Re: [DISCUSS] Releasing 1.15.1

2022-06-15 Thread David Anderson
I'm now thinking we should delay 1.15.1 long enough to see if we can include a fix for FLINK-28060 [1], which is a serious regression affecting several Kafka users. [1] https://issues.apache.org/jira/browse/FLINK-28060 On Fri, Jun 10, 2022 at 12:15 PM David Anderson wrote: > Since no one has br

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-06-15 Thread Jiangang Liu
+1 Chesnay Schepler 于2022年6月15日周三 17:15写道: > +1 > > On 15/06/2022 10:49, Lijie Wang wrote: > > Hi everyone, > > > > We've received some additional concerns since the last vote [1], and > > therefore made a lot of changes to design. You can find the details in > [2] > > and the discussions in [3

[jira] [Created] (FLINK-28078) ZooKeeperMultipleComponentLeaderElectionDriverTest.testLeaderElectionWithMultipleDrivers runs into timeout

2022-06-15 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-28078: - Summary: ZooKeeperMultipleComponentLeaderElectionDriverTest.testLeaderElectionWithMultipleDrivers runs into timeout Key: FLINK-28078 URL: https://issues.apache.org/jira/browse/

[jira] [Created] (FLINK-28077) KeyedStateCheckpointingITCase.testWithMemoryBackendSync runs into timeout

2022-06-15 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-28077: - Summary: KeyedStateCheckpointingITCase.testWithMemoryBackendSync runs into timeout Key: FLINK-28077 URL: https://issues.apache.org/jira/browse/FLINK-28077 Project:

[jira] [Created] (FLINK-28076) CI runs keep getting stuck

2022-06-15 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-28076: - Summary: CI runs keep getting stuck Key: FLINK-28076 URL: https://issues.apache.org/jira/browse/FLINK-28076 Project: Flink Issue Type: Bug Affects Vers

Re: [VOTE] FLIP-224: Blocklist Mechanism

2022-06-15 Thread Chesnay Schepler
+1 On 15/06/2022 10:49, Lijie Wang wrote: Hi everyone, We've received some additional concerns since the last vote [1], and therefore made a lot of changes to design. You can find the details in [2] and the discussions in [3]. Now I'd like to start a new vote thread for FLIP-224. The vote wil

[jira] [Created] (FLINK-28075) get statistics for partitioned table even without partition pruning

2022-06-15 Thread godfrey he (Jira)
godfrey he created FLINK-28075: -- Summary: get statistics for partitioned table even without partition pruning Key: FLINK-28075 URL: https://issues.apache.org/jira/browse/FLINK-28075 Project: Flink

[jira] [Created] (FLINK-28074) display

2022-06-15 Thread godfrey he (Jira)
godfrey he created FLINK-28074: -- Summary: display Key: FLINK-28074 URL: https://issues.apache.org/jira/browse/FLINK-28074 Project: Flink Issue Type: New Feature Reporter: godfrey he

[VOTE] FLIP-224: Blocklist Mechanism

2022-06-15 Thread Lijie Wang
Hi everyone, We've received some additional concerns since the last vote [1], and therefore made a lot of changes to design. You can find the details in [2] and the discussions in [3]. Now I'd like to start a new vote thread for FLIP-224. The vote will last for at least 72 hours unless there is

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-06-15 Thread Lijie Wang
Thanks Chesnay & Zhu. I will start a new vote thread soon. Best, Lijie Chesnay Schepler 于2022年6月15日周三 15:49写道: > To expand a bit for transparency, Zhu Zhu and I had long discussion > (literally spanning days) about this FLIP and it's relation to > speculative execution. > > The gist of it is t

Re: Re: [DISCUSS] FLIP-240: Introduce "ANALYZE TABLE" Syntax

2022-06-15 Thread godfrey he
Hi Jark, Thanks for the inputs. >Do we need to provide DESC EXTENDED statement like Spark[1] to >show statistic for table/partition/columns? We do have supported `DESC EXTENDED` syntax, but currently only table schema will be display, I think we just need a JIRA to support it. > is it possible

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-06-15 Thread Chesnay Schepler
To expand a bit for transparency, Zhu Zhu and I had long discussion (literally spanning days) about this FLIP and it's relation to speculative execution. The gist of it is that speculative execution doesn't strictly need the block list; just _some_ mechanism to select/request slots from other

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-15 Thread Xintong Song
Thanks Junhan, +1 for the proposed improvements. Best, Xintong On Wed, Jun 15, 2022 at 3:16 PM Yangze Guo wrote: > Thanks for driving this, Junhan. > > I think it's a valuable usability improvement for both streaming and > batch users. Looking forward to the community feedback. > > Best, >

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-06-15 Thread Zhu Zhu
Hi everyone, Thank you all for the feedback! We receive concerns that the blocklist feature is not strongly required except for the needs of speculative execution. So as the first step, we will limit the scope of FLIP-224 to only support speculative execution, and therefore, not add public interfa

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Sergey Nuyanzin
Congratulations, Jingsong! On Wed, Jun 15, 2022 at 8:45 AM Jingsong Li wrote: > Thanks everyone. > > It's great to be with you in the Flink community! > > Best, > Jingsong > > On Wed, Jun 15, 2022 at 2:11 PM Yun Gao > wrote: > > > > Congratulations, Jingsong! > > > > Best, > > Yun Gao > > > > >

Re: [DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-15 Thread Yangze Guo
Thanks for driving this, Junhan. I think it's a valuable usability improvement for both streaming and batch users. Looking forward to the community feedback. Best, Yangze Guo On Wed, Jun 15, 2022 at 3:10 PM junhan yang wrote: > > Hi all, > > I would like to open a discussion on FLIP-241: Comp

[DISCUSS] FLIP-241: Completed Jobs Information Enhancement

2022-06-15 Thread junhan yang
Hi all, I would like to open a discussion on FLIP-241: Completed Jobs Information Enhancement. As far as we can tell, streaming and batch users have different interests in probing a job. As Flink grows into a unified streaming & batch processor and is adopted by more and more batch users, the use