[jira] [Created] (FLINK-29803) Table API Scala APIs lack proper source jars

Chesnay Schepler created FLINK-29803: Summary: Table API Scala APIs lack proper source jars Key: FLINK-29803 URL: https://issues.apache.org/jira/browse/FLINK-29803 Project: Flink Issue Ty

Re: Want to help upgrading Flink ElasticSearch connector

Hi Elkhan, Thanks for reaching out. However, this upgrade path isn't possible because the Elastic license for version 7.17 is not compatible with the Apache License. The only way that support for Elasticsearch 8 can be created is by moving away from the High Level REST Client (which has also been

[jira] [Created] (FLINK-29804) Support convertion of Correlate to Join if correlation variable is unused introduced in Calcite 1.28

Sergey Nuyanzin created FLINK-29804: --- Summary: Support convertion of Correlate to Join if correlation variable is unused introduced in Calcite 1.28 Key: FLINK-29804 URL: https://issues.apache.org/jira/browse/FLI

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

+1 On 28/10/2022 16:57, Piotr Nowojski wrote: Hi, As discussed on the dev mailing list [0] I would like to start a vote to drop support of older savepoint formats (for Flink versions older than 1.8). You can find the original explanation from the aforementioned dev mailing list thread at the bo

Re: [DISCUSS] Delete useless branches from Flink repository

Hi, benchmark_request is used by default by the jenkins benchmark request job. However I think no-one is using this anymore, and everybody starts benchmark requests from his own repository forks/clones. So the benchmark_request could be deleted, but only if someone would also clean up/adjust the J

[jira] [Created] (FLINK-29805) Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow

Caizhi Weng created FLINK-29805: --- Summary: Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow Key: FLINK-29805 URL: https://issues.apache.org/jira/b

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Nice work everyone! Congratulations to all involved :D Danny, On Mon, Oct 31, 2022 at 4:07 AM Paul Lam wrote: > Congrats! Finally! > > Best, > Paul Lam > > > 2022年10月31日 11:58，Yuxin Tan 写道： > > > > Congrats! Glad to hear that. > > > > Best, > > Yuxin > > > > > > weijie guo 于2022年10月31日周一 11:

Re: [VOTE] Dedicated AWS externalized connector repo

The vote has passed unanimously. +1 Votes: - Martijn (binding) - Hong (non-binding) - Ahmed (non-binding) - Samrat (non-binding) - Jing (non-binding) - Jark (binding) - Jiangjie (binding) Thanks all. On Mon, Oct 31, 2022 at 2:37 AM Becket Qin wrote: > +1 (binding) > > Thanks, > > Jiangjie (Bec

Re: [DISCUSS] Delete useless branches from Flink repository

> So the > benchmark_request could be deleted, but only if someone would also clean > up/adjust the Jenkins's job default parameters. Thanks @Piotr for suppling this background. As an upstream repository, I tend to keep it as clean as possible. These users(I think they’re experienced developers)

[jira] [Created] (FLINK-29806) Move related class StateChangeOperation into package org.apache.flink.state.changelog.restore

senbork created FLINK-29806: --- Summary: Move related class StateChangeOperation into package org.apache.flink.state.changelog.restore Key: FLINK-29806 URL: https://issues.apache.org/jira/browse/FLINK-29806

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Congrats! Thanks everyone who is making this release happen! Best Yuan On Mon, Oct 31, 2022 at 5:18 PM Danny Cranmer wrote: > Nice work everyone! > > Congratulations to all involved :D > > Danny, > > On Mon, Oct 31, 2022 at 4:07 AM Paul Lam wrote: > > > Congrats! Finally! > > > > Best, > > Pau

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

+1 Best Yuan On Mon, Oct 31, 2022 at 5:01 PM Dawid Wysakowicz wrote: > +1 > > On 28/10/2022 16:57, Piotr Nowojski wrote: > > Hi, > > > > As discussed on the dev mailing list [0] I would like to start a vote to > > drop support of older savepoint formats (for Flink versions older than > > 1.8).

Re: [DISCUSS] Delete useless branches from Flink repository

Hi, Actually I double checked it and the default branch on jenkins is `master`. So `benchmark-request` branch can be safely removed without any further changes. Best, Piotrek pon., 31 paź 2022 o 10:34 Leonard Xu napisał(a): > > So the > > benchmark_request could be deleted, but only if someone

[jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

Piotr Nowojski created FLINK-29807: -- Summary: Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0 Key: FLINK-29807 URL: https://issues.apache.org/jira/browse/FLINK-29807

[jira] [Created] (FLINK-29808) Grant leadership to leaderContender while it is closing may lead to deadlock

Weijie Guo created FLINK-29808: -- Summary: Grant leadership to leaderContender while it is closing may lead to deadlock Key: FLINK-29808 URL: https://issues.apache.org/jira/browse/FLINK-29808 Project: Fli

Re: [jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

unsubscribe | | 15725139...@163.com | | 邮箱：15725139...@163.com | Replied Message | From | Piotr Nowojski (Jira) | | Date | 10/31/2022 17:55 | | To | dev@flink.apache.org | | Cc | | | Subject | [jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support f

[jira] [Created] (FLINK-29809) REST API for running a Flink job

Nguyễn Minh Phú created FLINK-29809: --- Summary: REST API for running a Flink job Key: FLINK-29809 URL: https://issues.apache.org/jira/browse/FLINK-29809 Project: Flink Issue Type: Improvemen

Re: [VOTE] Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

+1 On 28/10/2022 16:57, Piotr Nowojski wrote: Hi, As discussed on the dev mailing list [0] I would like to start a vote to drop support of older savepoint formats (for Flink versions older than 1.8). You can find the original explanation from the aforementioned dev mailing list thread at the bo

[jira] [Created] (FLINK-29810) AzureFileSystemBehaviorITCase is not executed on AzureCI

Matthias Pohl created FLINK-29810: - Summary: AzureFileSystemBehaviorITCase is not executed on AzureCI Key: FLINK-29810 URL: https://issues.apache.org/jira/browse/FLINK-29810 Project: Flink Is

[jira] [Created] (FLINK-29811) HadoopOSSFileSystemBehaviorITCase is not executed on AzureCI

Matthias Pohl created FLINK-29811: - Summary: HadoopOSSFileSystemBehaviorITCase is not executed on AzureCI Key: FLINK-29811 URL: https://issues.apache.org/jira/browse/FLINK-29811 Project: Flink

[jira] [Created] (FLINK-29813) Remove deprecated Curator API usages

Chesnay Schepler created FLINK-29813: Summary: Remove deprecated Curator API usages Key: FLINK-29813 URL: https://issues.apache.org/jira/browse/FLINK-29813 Project: Flink Issue Type: Tech

[jira] [Created] (FLINK-29812) Remove deprecated Netty API usages

Chesnay Schepler created FLINK-29812: Summary: Remove deprecated Netty API usages Key: FLINK-29812 URL: https://issues.apache.org/jira/browse/FLINK-29812 Project: Flink Issue Type: Techni

[jira] [Created] (FLINK-29814) Upgrade Stateful Functions to use Flink 1.15

Fil Karnicki created FLINK-29814: Summary: Upgrade Stateful Functions to use Flink 1.15 Key: FLINK-29814 URL: https://issues.apache.org/jira/browse/FLINK-29814 Project: Flink Issue Type: Impr

Re: Stateful Functions with Flink 1.15 and onwards

Hi All So what's the play here? Galen, what do you think about taking this on? Perhaps ++Till would assign this jira to you (with your permission) given he's helped me out with statefun work before https://issues.apache.org/jira/browse/FLINK-29814 I can try to move to move statefun to flink 1.16

Re: Stateful Functions with Flink 1.15 and onwards

Yes, I could do that. On Mon, Oct 31, 2022 at 7:48 AM Filip Karnicki wrote: > Hi All > > So what's the play here? > > Galen, what do you think about taking this on? Perhaps ++Till would assign > this jira to you (with your permission) given he's helped me out > with statefun work before > https:

Re: [DISCUSS] Delete useless branches from Flink repository

> Actually I double checked it and the default branch on jenkins is `master`. Great, I’ve deleted benchmark-request branch. Now, our repo looks better. Best, Leonard

[jira] [Created] (FLINK-29815) image apache/flink:1.16.0-scala_2.12 does not exist

Harkin created FLINK-29815: -- Summary: image apache/flink:1.16.0-scala_2.12 does not exist Key: FLINK-29815 URL: https://issues.apache.org/jira/browse/FLINK-29815 Project: Flink Issue Type: Bug A

support Kryo.setRegistrationRequired(false)

Hi all, I'd be interested to pick up this existing JIRA ticket, to add support to configure whether Kryo requires registrations for all serialized objects. [FLINK-25993] Option to disable Kryo.setRegistrationRequired(false) - ASF JIRA (apache.org)

Re: Stateful Functions with Flink 1.15 and onwards

Hi folks, if you can open a PR for supporting Flink 1.15 Galen, then this would be awesome. I've assigned you to this ticket. The next thing after merging this PR would be creating a new StateFun release. Once we have merged the PR, let's check who can help with it the fastest. Cheers, Till On M

[jira] [Created] (FLINK-29816) Userfunction exception in ProcessWindowFunction was called before invoke during restore state(subtask was in INITIALIZING state), but SteamTask skip handle Exception

Xie Yi created FLINK-29816: -- Summary: Userfunction exception in ProcessWindowFunction was called before invoke during restore state(subtask was in INITIALIZING state), but SteamTask skip handle Exception Key: FLINK-29816

[GitHub] [flink-connector-shared-utils] zentol opened a new pull request, #1: Add first version of release scripts

zentol opened a new pull request, #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1 This PR adds the first version of shared release utilities for connectors. The expectation is that the `release_utils` branch will be mounted as a git submodule into each connector

[GitHub] [flink-connector-shared-utils] zentol commented on pull request #1: [FLINK-29472] Add first version of release scripts

zentol commented on PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#issuecomment-1297059496 Note that we could just do a review round, and then try them out for the ES connector release before merging them. -- This is an automated message from the Apache Git Ser

Re: Stateful Functions with Flink 1.15 and onwards

Sure thing. One question -- Flink 1.16 was just released a few days ago. Should I support 1.15, or just go straight to 1.16? On Mon, Oct 31, 2022 at 8:49 AM Till Rohrmann wrote: > Hi folks, > > if you can open a PR for supporting Flink 1.15 Galen, then this would be > awesome. I've assigned you

[ANNOUNCE] Starting with Flink 1.17 release sync

Hi everyone, We want to let you know that with Flink 1.16 now available, we'll focus on the Flink 1.17 release. [1] As part of that release, we'll continue with our release sync meetings. At first, they will be every 2 weeks and when the feature freeze gets closer, we'll move to weekly meetings.

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Thanks everyone for making this release happen. Best, Matthias On Mon, Oct 31, 2022 at 10:47 AM Yuan Mei wrote: > Congrats! Thanks everyone who is making this release happen! > > Best > Yuan > > On Mon, Oct 31, 2022 at 5:18 PM Danny Cranmer > wrote: > > > Nice work everyone! > > > > Congratula

[jira] [Created] (FLINK-29817) Published metadata for apache-flink in pypi are inconsistent and causes poetry to fail

André Casimiro created FLINK-29817: -- Summary: Published metadata for apache-flink in pypi are inconsistent and causes poetry to fail Key: FLINK-29817 URL: https://issues.apache.org/jira/browse/FLINK-29817

[jira] [Created] (FLINK-29818) HsResultPartitionTest.testAvailability fails

Sergey Nuyanzin created FLINK-29818: --- Summary: HsResultPartitionTest.testAvailability fails Key: FLINK-29818 URL: https://issues.apache.org/jira/browse/FLINK-29818 Project: Flink Issue Ty

[DISCUSS] Flink release retro

Hi everyone, I want to bring up the idea of having a retrospective on the release from the release manager's perspective. The idea would be to collect feedback on what went well and what could be improved for a specific minor release. So far, I didn't find anything on that topic. Does the community

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Congratulations! Thanks everyone involved! On Mon, Oct 31, 2022 at 3:15 PM Matthias Pohl wrote: > Thanks everyone for making this release happen. > > Best, > Matthias > > On Mon, Oct 31, 2022 at 10:47 AM Yuan Mei wrote: > > > Congrats! Thanks everyone who is making this release happen! > > > >

Re: Stateful Functions with Flink 1.15 and onwards

I think there might still be value in supporting 1.15 since not everyone upgrades Flink very fast. Hopefully, for Statefun the diff between Flink 1.15 and 1.16 boils down to changing the Flink dependencies. Cheers, Till On Mon, Oct 31, 2022 at 2:06 PM Galen Warren wrote: > Sure thing. One quest

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

Thanks Martijn. What you said makes a lot of sense. I figure we should do it in 2 steps. Step 1 (with 1.17): - Remove FlinkKafkaConsumer. - Graduate Kafka Source from @PublicEvolving to @Public. - Update doc and leave hints for customers as the reference. According to [1], the Kafka Sink should

[jira] [Created] (FLINK-29819) Record an error event when savepoint fails within grace period

Clara Xiong created FLINK-29819: --- Summary: Record an error event when savepoint fails within grace period Key: FLINK-29819 URL: https://issues.apache.org/jira/browse/FLINK-29819 Project: Flink

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

+1, thanks for driving this! On a side note, can we also ensure that a performance summary report for Flink major version upgrades is in release notes, once this infrastructure becomes mature? From the user perspective, it would be nice to know what the expected (or unexpected) regressions in a ma

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

Hi, Maybe a stupid question, but how one can migrate from the FlinkKafkaConsumer/FlinkKafkaProducer to KafkaSource/KafkaSink, while preserving exactly-once guarantees etc? Is it possible? I've tried a quick search and couldn't find it, but maybe I was looking in wrong places. Best, Piotrek pon.,

Re: Stateful Functions with Flink 1.15 and onwards

Yes, that makes sense. PR is here: [FLINK-29814][statefun] Change supported Flink version to 1.15.2 by galenwarren · Pull Request #319 · apache/flink-statefun (github.com) . On Mon, Oct 31, 2022 at 11:35 AM Till Rohrmann wrote: > I think there

Re: [VOTE] FLIP-263: Improve resolving schema compatibility

+1. Thanks Hangxiang, the proposed plan looks good! On Sun, Oct 30, 2022 at 3:38 AM Yu Li wrote: > +1 (binding) > > Thanks Hangxiang for driving this and thanks all for the thorough > discussion. > > Best Regards, > Yu > > > On Fri, 28 Oct 2022 at 16:01, Dawid Wysakowicz > wrote: > > > +1, > >

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

Hey all, Since we are planning to externalize the connectors by Flink 1.17, we will not need to wait until Flink 1.18 for Step 2. We can fast follow with a new connector version implementing Step 2 post externalization (assuming we have met the bake time discussed in FLIP-197 [1]). I noted there

Re: [ANNOUNCE] Apache Flink 1.16.0 released

Congratulations! Best, Liudalong Sergey Nuyanzin 于2022年10月31日周一 23:25写道： > Congratulations! > Thanks everyone involved! > > On Mon, Oct 31, 2022 at 3:15 PM Matthias Pohl > wrote: > > > Thanks everyone for making this release happen. > > > > Best, > > Matthias > > > > On Mon, Oct 31, 2022 at 10:

[jira] [Created] (FLINK-29820) Support to read data from table store with specify snapshot id

Shammon created FLINK-29820: --- Summary: Support to read data from table store with specify snapshot id Key: FLINK-29820 URL: https://issues.apache.org/jira/browse/FLINK-29820 Project: Flink Issue T

[jira] [Created] (FLINK-29821) Schema.Builder how to set not null column?

Alvin Ge created FLINK-29821: Summary: Schema.Builder how to set not null column? Key: FLINK-29821 URL: https://issues.apache.org/jira/browse/FLINK-29821 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29822) Fix wrong description in comments of StreamExecutionEnvironment#setMaxParallelism()

Feifan Wang created FLINK-29822: --- Summary: Fix wrong description in comments of StreamExecutionEnvironment#setMaxParallelism() Key: FLINK-29822 URL: https://issues.apache.org/jira/browse/FLINK-29822 Pro

Re: [jira] [Created] (FLINK-29807) Drop TypeSerializerConfigSnapshot and savepoint support from Flink versions < 1.8.0

Hi, 15725139602 Please send email to dev-unsubscr...@flink.apache.org if you want to unsubscribe the mail from dev , and you can refer[1] for more details. Best, Leonard [1]https://flink.apache.org/community.html#mailing-lists > 2022年10月31日 下午6:02，m15725139602 <15725139...@163.com> 写道： > > u

[jira] [Created] (FLINK-29823) Support create schema for table snapshot

Shammon created FLINK-29823: --- Summary: Support create schema for table snapshot Key: FLINK-29823 URL: https://issues.apache.org/jira/browse/FLINK-29823 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Delete useless branches from Flink repository

Hi Leonard, Thanks for driving this topic, I think the release candidate branch after flink-1.10 could be deleted. I believe those branches are created by mistake as the release manager should use tags instead of branch to hold the release candidate. Those branches are: release-1.12.3-rc1

Re: [VOTE] FLIP-263: Improve resolving schema compatibility

+1 (binding) Thanks Hangxiang for driving this topic. Best Yun Tang From: Tzu-Li (Gordon) Tai Sent: Tuesday, November 1, 2022 5:21 To: dev@flink.apache.org Subject: Re: [VOTE] FLIP-263: Improve resolving schema compatibility +1. Thanks Hangxiang, the proposed p

[jira] [Created] (FLINK-29824) AgglomerativeClustering fails when the distanceThreshold is very large

Zhipeng Zhang created FLINK-29824: - Summary: AgglomerativeClustering fails when the distanceThreshold is very large Key: FLINK-29824 URL: https://issues.apache.org/jira/browse/FLINK-29824 Project: Fli

[jira] [Created] (FLINK-29825) Improve benchmark stablility

Yanfei Lei created FLINK-29825: -- Summary: Improve benchmark stablility Key: FLINK-29825 URL: https://issues.apache.org/jira/browse/FLINK-29825 Project: Flink Issue Type: Improvement Co

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

Congratulations Danny! Best regards, Weijie Maximilian Michels 于2022年10月13日周四 21:41写道： > Congratulations Danny! Well deserved :) > > -Max > > On Thu, Oct 13, 2022 at 2:40 PM Yang Wang wrote: > > > Congratulations Danny! > > > > Best, > > Yang > > > > Hang Ruan 于2022年10月13日周四 10:58写道： > > >

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

> > [H]ow one can migrate from the > FlinkKafkaConsumer/FlinkKafkaProducer to KafkaSource/KafkaSink, while > preserving exactly-once guarantees etc? The responses from Fabian Paul in [1] and [2] address the question of how to handle the migration in terms of managing the state (where the short an