Re: [DISCUSS] Move CheckpointingMode to flink-core

2024-02-27 Thread Zakelly Lan
Hi Lincoln, Given that we have finished the testing for 1.19, I agree it is better not merge this into 1.19. Thanks for RMs' attention! Hi Chesney and Junrui, Thanks for your advice. My original intention is to move the class as well as change the package to make it clean. But it involves much

Re: [ANNOUNCE] Flink 1.19 Cross-team testing completed & sync summary on 02/27/2024

2024-02-27 Thread Jingsong Li
Thanks Lincoln and all contributors! Best, Jingsong On Wed, Feb 28, 2024 at 12:15 PM Xintong Song wrote: > > Matthias has already said it on the release sync, but I still want to say > it again. It's amazing how smooth the release testing goes for this > release. Great thanks to the release

Re: [ANNOUNCE] Flink 1.19 Cross-team testing completed & sync summary on 02/27/2024

2024-02-27 Thread Xintong Song
Matthias has already said it on the release sync, but I still want to say it again. It's amazing how smooth the release testing goes for this release. Great thanks to the release managers and all contributors who make this happen. Best, Xintong On Wed, Feb 28, 2024 at 10:10 AM Lincoln Lee

Re: [VOTE] FLIP-314: Support Customized Job Lineage Listener

2024-02-27 Thread Peter Huang
+1 (non-binding) Thanks for consolidating the opinions from both Flink and OpenLineage communities. Look forward to the collaboration. Best Regards Peter Huang On Tue, Feb 27, 2024 at 6:13 PM Yong Fang wrote: > Hi devs, > > I would like to restart a vote about FLIP-314: Support Customized

[jira] [Created] (FLINK-34535) Support JobPlanInfo for the explain result

2024-02-27 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-34535: -- Summary: Support JobPlanInfo for the explain result Key: FLINK-34535 URL: https://issues.apache.org/jira/browse/FLINK-34535 Project: Flink Issue Type:

Flink kinesis connector v4.2.0-1.18 has issue when consuming from EFO consumer

2024-02-27 Thread Xiaolong Wang
Hi, I used the flink-connector-kinesis (4.0.2-1.18) to consume from Kinesis. The job can start but will fail within 1 hour. Detailed error log is attached. When I changed the version of the flink-connector-kinesis to `1.15.2` , everything settled. Any idea to fix it ? create table

Re: Requesting link to join Slack Community

2024-02-27 Thread Hang Ruan
Hi, Geetesh. Here is the invite link : https://join.slack.com/t/apache-flink/shared_invite/zt-1t4khgllz-Fm1CnXzdBbUchBz4HzJCAg . I will raise a PR to update the link. Best, Hang Geetesh Nikhade 于2024年2月28日周三 04:49写道: > Hi Folks, > > I would like to join the Apache Flink Community on Slack,

Re: [DISCUSS] Move CheckpointingMode to flink-core

2024-02-27 Thread Junrui Lee
Hi Zakelly, I agree with Chesnay's response. I would suggest that during the process of moving CheckpointingMode from the flink-streaming-java module to the flink-core module, we should keep the package name unchanged. This approach would be completely transparent to users. In fact, this practice

[VOTE] FLIP-314: Support Customized Job Lineage Listener

2024-02-27 Thread Yong Fang
Hi devs, I would like to restart a vote about FLIP-314: Support Customized Job Lineage Listener[1]. Previously, we added lineage related interfaces in FLIP-314. Before the interfaces were developed and merged into the master, @Maciej and @Zhenqiu provided valuable suggestions for the interface

[ANNOUNCE] Flink 1.19 Cross-team testing completed & sync summary on 02/27/2024

2024-02-27 Thread Lincoln Lee
Hi devs, I'd like to share some highlights from the release sync on 02/27/2024 - Cross-team testing We've finished all of the testing work[1]. Huge thanks to all contributors and volunteers for the effort on this! - Blockers Two api change merge requests[2][3] had been discussed, there was an

Re: [DISCUSS] Move CheckpointingMode to flink-core

2024-02-27 Thread Chesnay Schepler
Moving classes (== keep the same package) to a module higher up in the dependency tree should not be a breaking change and can imo be done anytime without any risk to users. On 27/02/2024 17:01, Lincoln Lee wrote: Hi Zakelly, Thanks for letting us 1.19 RMs know about this! This change has

Requesting link to join Slack Community

2024-02-27 Thread Geetesh Nikhade
Hi Folks, I would like to join the Apache Flink Community on Slack, but it looks like the link shared on official flink website seems to have expired. Can someone please share a new join link? or let me know what would be the best way to get that link? Thanks in advance. Best, Geetesh

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-02-27 Thread Kevin Lam
Hey Robert, Thanks for your response. I have a partial implementation, just for the decoding portion. The code I have is pretty rough and doesn't do any of the refactors I mentioned, but the decoder logic does pull the schema from the schema registry and use that to deserialize the

Re: [DISCUSS] Move CheckpointingMode to flink-core

2024-02-27 Thread Lincoln Lee
Hi Zakelly, Thanks for letting us 1.19 RMs know about this! This change has been discussed during today's release sync meeting, we suggest not merge it into 1.19. We can continue discussing the removal in 2.x separately. Best, Lincoln Lee Hangxiang Yu 于2024年2月27日周二 11:28写道: > Hi, Zakelly. >

[jira] [Created] (FLINK-34534) CLONE - Vote on the release candidate

2024-02-27 Thread lincoln lee (Jira)
lincoln lee created FLINK-34534: --- Summary: CLONE - Vote on the release candidate Key: FLINK-34534 URL: https://issues.apache.org/jira/browse/FLINK-34534 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34533) CLONE - Propose a pull request for website updates

2024-02-27 Thread lincoln lee (Jira)
lincoln lee created FLINK-34533: --- Summary: CLONE - Propose a pull request for website updates Key: FLINK-34533 URL: https://issues.apache.org/jira/browse/FLINK-34533 Project: Flink Issue Type:

[jira] [Created] (FLINK-34532) CLONE - Stage source and binary releases on dist.apache.org

2024-02-27 Thread lincoln lee (Jira)
lincoln lee created FLINK-34532: --- Summary: CLONE - Stage source and binary releases on dist.apache.org Key: FLINK-34532 URL: https://issues.apache.org/jira/browse/FLINK-34532 Project: Flink

[jira] [Created] (FLINK-34531) CLONE - Build and stage Java and Python artifacts

2024-02-27 Thread lincoln lee (Jira)
lincoln lee created FLINK-34531: --- Summary: CLONE - Build and stage Java and Python artifacts Key: FLINK-34531 URL: https://issues.apache.org/jira/browse/FLINK-34531 Project: Flink Issue Type:

[jira] [Created] (FLINK-34530) Build Release Candidate: 1.19.0-rc1

2024-02-27 Thread lincoln lee (Jira)
lincoln lee created FLINK-34530: --- Summary: Build Release Candidate: 1.19.0-rc1 Key: FLINK-34530 URL: https://issues.apache.org/jira/browse/FLINK-34530 Project: Flink Issue Type: New Feature

Re: [VOTE] Release flink-connector-parent 1.1.0 release candidate #2

2024-02-27 Thread Chesnay Schepler
+1 - pom contents - source contents - Website PR On 19/02/2024 18:33, Etienne Chauchot wrote: Hi everyone, Please review and vote on the release candidate #2 for the version 1.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments)

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-02-27 Thread Robert Metzger
Hi all, +1 to support the format in Flink. @Kevin: Do you already have an implementation for this inhouse that you are looking to upstream, or would you start from scratch? I'm asking because my current employer, Confluent, has a Protobuf Schema registry implementation for Flink, and I could

[jira] [Created] (FLINK-34529) Projection cannot be pushed down through rank operator.

2024-02-27 Thread yisha zhou (Jira)
yisha zhou created FLINK-34529: -- Summary: Projection cannot be pushed down through rank operator. Key: FLINK-34529 URL: https://issues.apache.org/jira/browse/FLINK-34529 Project: Flink Issue

Re: [DISCUSS] Apache Bahir retired

2024-02-27 Thread Ferenc Csaky
Thank you Leonard for sharing your thoughts on this topic. I agree that complying with the Flink community connector development process would be a must, if there are no legal or copyright issues, I would be happy to take that task for this particular case. I am no legal/copyright expert myslef,

[jira] [Created] (FLINK-34528) With shuffling data, when a Task Manager is killed, restarting the Flink job takes a considerable amount of time

2024-02-27 Thread junzhong qin (Jira)
junzhong qin created FLINK-34528: Summary: With shuffling data, when a Task Manager is killed, restarting the Flink job takes a considerable amount of time Key: FLINK-34528 URL:

[jira] [Created] (FLINK-34527) Deprecate Time classes also in PyFlink

2024-02-27 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34527: - Summary: Deprecate Time classes also in PyFlink Key: FLINK-34527 URL: https://issues.apache.org/jira/browse/FLINK-34527 Project: Flink Issue Type: Bug