[jira] [Created] (FLINK-34544) The release check bug in tiered memory manager of hybrid shuffle

Yuxin Tan created FLINK-34544: - Summary: The release check bug in tiered memory manager of hybrid shuffle Key: FLINK-34544 URL: https://issues.apache.org/jira/browse/FLINK-34544 Project: Flink

[DISCUSS] FLIP-423 ～FLIP-428: Introduce Disaggregated State Storage and Management in Flink 2.0

Hi Devs, This is a joint work of Yuan Mei, Zakelly Lan, Jinzhong Li, Hangxiang Yu, Yanfei Lei and Feng Wang. We'd like to start a discussion about introducing Disaggregated State Storage and Management in Flink 2.0. The past decade has witnessed a dramatic shift in Flink's deployment mode,

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

Congratulations Jiabao! Best regards, Jiadong Lu On 2024/2/29 11:23, Shawn Huang wrote: Congratulations Jiabao!

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

Congratulations Jiabao! Best, Shawn Huang yh z 于2024年2月26日周一 16:17写道： > Congratulations Jiabao! > > Best, > Yunhong Zheng (SwufeHong) > > yu'an huang 于2024年2月26日周一 10:28写道： > > > Congratulations, Jiabao! > > > > Best, > > Yuan > > > > > > On Mon, 26 Feb 2024 at 9:38 AM, Ron liu wrote: > > >

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (non-binding) Best, Hang weijie guo 于2024年2月29日周四 09:55写道： > +1 (binding) > > Best regards, > > Weijie > > > Feng Jin 于2024年2月29日周四 09:37写道： > > > +1 (non-binding) > > > > Best, > > Feng Jin > > > > On Thu, Feb 29, 2024 at 4:41 AM Márton Balassi > > > wrote: > > > > > +1 (binding) > > > >

Re: Flink kinesis connector v4.2.0-1.18 has issue when consuming from EFO consumer

Sorry, I just attached a wrong file. Let me paste the error log: java.lang.RuntimeException: Maximum retries exceeded for SubscribeToShard. Failed 10 times. at org.apache.flink.streaming.connectors.kinesis.internals.publisher.fanout.FanOutRecordPublisher.runWithBackoff(FanOutRecordPublisher.java:

[jira] [Created] (FLINK-34543) Support Full Partition Processing On Non-keyed DataStream

Wencong Liu created FLINK-34543: --- Summary: Support Full Partition Processing On Non-keyed DataStream Key: FLINK-34543 URL: https://issues.apache.org/jira/browse/FLINK-34543 Project: Flink

[jira] [Created] (FLINK-34542) Improve Gradle Quick Start build.gradle with Better Gradle API Alternatives

Lennon Yu created FLINK-34542: - Summary: Improve Gradle Quick Start build.gradle with Better Gradle API Alternatives Key: FLINK-34542 URL: https://issues.apache.org/jira/browse/FLINK-34542 Project: Flink

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (binding) Best regards, Weijie Feng Jin 于2024年2月29日周四 09:37写道： > +1 (non-binding) > > Best, > Feng Jin > > On Thu, Feb 29, 2024 at 4:41 AM Márton Balassi > wrote: > > > +1 (binding) > > > > Marton > > > > On Wed, Feb 28, 2024 at 5:14 PM Gyula Fóra wrote: > > > > > +1 (binding) > > > > >

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (non-binding) Best, Feng Jin On Thu, Feb 29, 2024 at 4:41 AM Márton Balassi wrote: > +1 (binding) > > Marton > > On Wed, Feb 28, 2024 at 5:14 PM Gyula Fóra wrote: > > > +1 (binding) > > > > Gyula > > > > On Wed, Feb 28, 2024 at 11:10 AM Maciej Obuchowski < > mobuchow...@apache.org > > > >

Question around Flink's AdaptiveBatchScheduler

Hi Flink devs, With Flink's AdaptiveBatchScheduler (Note: this is different from AdaptiveScheduler

[jira] [Created] (FLINK-34541) Flink uses insecure http confluent endpoint in its build

PJ Fanning created FLINK-34541: -- Summary: Flink uses insecure http confluent endpoint in its build Key: FLINK-34541 URL: https://issues.apache.org/jira/browse/FLINK-34541 Project: Flink Issue

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (binding) Marton On Wed, Feb 28, 2024 at 5:14 PM Gyula Fóra wrote: > +1 (binding) > > Gyula > > On Wed, Feb 28, 2024 at 11:10 AM Maciej Obuchowski > > wrote: > > > +1 (non-binding) > > > > Best, > > Maciej Obuchowski > > > > śr., 28 lut 2024 o 10:29 Zhanghao Chen > > napisał(a): > > > > >

Re: [DISCUSS] Apache Bahir retired

Hi all, +1 to have a connector FLIP to propose a Kudu connector. I'm +0 overall because I don't see a lot of activity happening in newly proposed connectors, but if there's demand for it and people want to volunteer with contributions, there's no reason to block it. Best regards, Martijn On

[jira] [Created] (FLINK-34540) Tune number of task slots

Maximilian Michels created FLINK-34540: -- Summary: Tune number of task slots Key: FLINK-34540 URL: https://issues.apache.org/jira/browse/FLINK-34540 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34539) Tune JobManager memory of autoscaled jobs

Maximilian Michels created FLINK-34539: -- Summary: Tune JobManager memory of autoscaled jobs Key: FLINK-34539 URL: https://issues.apache.org/jira/browse/FLINK-34539 Project: Flink Issue

[jira] [Created] (FLINK-34538) Tune memory of autoscaled jobs

Maximilian Michels created FLINK-34538: -- Summary: Tune memory of autoscaled jobs Key: FLINK-34538 URL: https://issues.apache.org/jira/browse/FLINK-34538 Project: Flink Issue Type: New

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (binding) Gyula On Wed, Feb 28, 2024 at 11:10 AM Maciej Obuchowski wrote: > +1 (non-binding) > > Best, > Maciej Obuchowski > > śr., 28 lut 2024 o 10:29 Zhanghao Chen > napisał(a): > > > +1 (non-binding) > > > > Best, > > Zhanghao Chen > > > > From: Yong

Re: [DISCUSS] Apache Bahir retired

Hi team, Thanks for bringing this up, Feri. I am +1 for maintaining the Kudu connector as an external Flink connector. As per the legal/trademark questions this is actually fair game because one does not donate code to a specific Apache project, technically it is donated to the Apache Software

Re: [DISCUSS] Move CheckpointingMode to flink-core

Personally, I'd be in favor of option 2. And based on the fact that migrating from the deprecated CheckpointingMode to the new one takes barely any effort (simply re-import the class), I'd be fine with removing the deprecated class in 2.0. But I'd also be fine with the other options. Either way,

Re: Flink kinesis connector v4.2.0-1.18 has issue when consuming from EFO consumer

Hi, Could you please provide more information on the error you are observing? Attached file does not have anything related to Kinesis or any errors. Best, Aleksandr On Wed, 28 Feb 2024 at 02:28, Xiaolong Wang wrote: > Hi, > > I used the flink-connector-kinesis (4.0.2-1.18) to consume from

[jira] [Created] (FLINK-34537) Autoscaler JDBC

ConradJam created FLINK-34537: - Summary: Autoscaler JDBC Key: FLINK-34537 URL: https://issues.apache.org/jira/browse/FLINK-34537 Project: Flink Issue Type: Improvement Components:

Re: [DISCUSS] Move CheckpointingMode to flink-core

Hi Zakelly, +1 for option 1. I prefer to minimize unnecessary additional development and discussions due to internal code relocations and to avoid imposing migration costs on users. Best regards, Junrui Zakelly Lan 于2024年2月28日周三 14:46写道： > Hi Lincoln, > > Given that we have finished the

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (non-binding) Best, Maciej Obuchowski śr., 28 lut 2024 o 10:29 Zhanghao Chen napisał(a): > +1 (non-binding) > > Best, > Zhanghao Chen > > From: Yong Fang > Sent: Wednesday, February 28, 2024 10:12 > To: dev > Subject: [VOTE] FLIP-314: Support Customized

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (non-binding) Best, Zhanghao Chen From: Yong Fang Sent: Wednesday, February 28, 2024 10:12 To: dev Subject: [VOTE] FLIP-314: Support Customized Job Lineage Listener Hi devs, I would like to restart a vote about FLIP-314: Support Customized Job Lineage

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

+1 (binding) Best, Yangze Guo On Wed, Feb 28, 2024 at 11:54 AM Peter Huang wrote: > > +1 (non-binding) > > Thanks for consolidating the opinions from both Flink and OpenLineage > communities. Look forward to the collaboration. > > > Best Regards > Peter Huang > > On Tue, Feb 27, 2024 at 6:13 PM

[RESULT] [VOTE] flink-connector-parent 1.1.0, release candidate #2

Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 8 approving votes, 3 of which are binding: * Qingsheng Ren (binding) * Rui Fan (non-binding) * Leonard Xu (binding) * Hang Ruan (non-binding) * Sergey Nuyanzin (non-binding) * Zhongqiang Gong

Re: [VOTE] Release flink-connector-parent 1.1.0 release candidate #2

Hi all, The vote on flink-connector-parent 1.1.0 RC2 is now closed. The result will be announced in a separate email. Best Etienne Le 27/02/2024 à 12:23, Chesnay Schepler a écrit : +1 - pom contents - source contents - Website PR On 19/02/2024 18:33, Etienne Chauchot wrote: Hi everyone,

[jira] [Created] (FLINK-34536) Support reading long value as Timestamp column in JSON format

yisha zhou created FLINK-34536: -- Summary: Support reading long value as Timestamp column in JSON format Key: FLINK-34536 URL: https://issues.apache.org/jira/browse/FLINK-34536 Project: Flink