[jira] [Created] (FLINK-29844) FLIP-263: Improve resolving schema compatibility

2022-11-01 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-29844: Summary: FLIP-263: Improve resolving schema compatibility Key: FLINK-29844 URL: https://issues.apache.org/jira/browse/FLINK-29844 Project: Flink Issue Type:

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-01 Thread Qingsheng Ren
Thanks Jing for starting the discussion. +1 for removing FlinkKafkaConsumer, as KafkaSource has evolved for many release cycles and should be stable enough. I have some concerns about the new Kafka sink based on sink v2, as sink v2 still has some ongoing work in 1.17 (maybe Yun Gao could provide

[jira] [Created] (FLINK-29843) Euclidean Distance Measure generates NAN distance values

2022-11-01 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-29843: Summary: Euclidean Distance Measure generates NAN distance values Key: FLINK-29843 URL: https://issues.apache.org/jira/browse/FLINK-29843 Project: Flink

[RESULT][VOTE] FLIP-263: Improve resolving schema compatibility

2022-11-01 Thread Hangxiang Yu
Hi everyone, Happy to announce that FLIP-263 [1] has been accepted. >From vote thread [2], There are 9 approving votes, 7 of which are binding: - Yanfei Lei (non-binding) - Yuan Mei (binding) - Zakelly Lan (non-binding) - Yun Gao (binding) - Godfrey He (binding) - Dawid Wysakowicz (binding)

[jira] [Created] (FLINK-29842) Change commitIdentifier in Table Store snapshot to long value

2022-11-01 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29842: --- Summary: Change commitIdentifier in Table Store snapshot to long value Key: FLINK-29842 URL: https://issues.apache.org/jira/browse/FLINK-29842 Project: Flink

[jira] [Created] (FLINK-29841) docs/content/docs/deployment/config.md has error

2022-11-01 Thread hcj (Jira)
hcj created FLINK-29841: --- Summary: docs/content/docs/deployment/config.md has error Key: FLINK-29841 URL: https://issues.apache.org/jira/browse/FLINK-29841 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29840) Old record may overwrite new record in Table Store when snapshot committing is slow

2022-11-01 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-29840: --- Summary: Old record may overwrite new record in Table Store when snapshot committing is slow Key: FLINK-29840 URL: https://issues.apache.org/jira/browse/FLINK-29840

[jira] [Created] (FLINK-29839) SQL Gateway with hiveserver2 throw exception

2022-11-01 Thread chenqizhu (Jira)
chenqizhu created FLINK-29839: - Summary: SQL Gateway with hiveserver2 throw exception Key: FLINK-29839 URL: https://issues.apache.org/jira/browse/FLINK-29839 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29838) Hive streaming sink for partitioned table should contain metastore by default

2022-11-01 Thread luoyuxia (Jira)
luoyuxia created FLINK-29838: Summary: Hive streaming sink for partitioned table should contain metastore by default Key: FLINK-29838 URL: https://issues.apache.org/jira/browse/FLINK-29838 Project: Flink

[jira] [Created] (FLINK-29837) SQL API does not expose the RowKind of the Row for processing Changelogs

2022-11-01 Thread Eric Xiao (Jira)
Eric Xiao created FLINK-29837: - Summary: SQL API does not expose the RowKind of the Row for processing Changelogs Key: FLINK-29837 URL: https://issues.apache.org/jira/browse/FLINK-29837 Project: Flink

[GitHub] [flink-connector-shared-utils] MartijnVisser commented on a diff in pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-01 Thread GitBox
MartijnVisser commented on code in PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1#discussion_r1010743355 ## README.md: ## @@ -1 +1,79 @@ -This repository contains utilities for [Apache Flink](https://flink.apache.org/) connectors. \ No newline at

Re: Stateful Functions with Flink 1.15 and onwards

2022-11-01 Thread Tzu-Li (Gordon) Tai
Btw, I'll assume that we're using this thread to gather consensus for code-freezing for 3.3.x series of StateFun. I know there hasn't been much activity on the repo, so this is just a formality really :) >From the commit history, it looks like we're mainly including the below major changes and

Re: Stateful Functions with Flink 1.15 and onwards

2022-11-01 Thread Galen Warren
Thanks Gordon and Filip, I appreciate your help on this one. On Tue, Nov 1, 2022 at 1:07 PM Tzu-Li (Gordon) Tai wrote: > PR for upgrading to Flink 1.15.2 has been merged. Thanks for the efforts, > Galen and Filip! > > We should be ready to kick off a new release for StateFun with the Flink >

Re: Stateful Functions with Flink 1.15 and onwards

2022-11-01 Thread Tzu-Li (Gordon) Tai
PR for upgrading to Flink 1.15.2 has been merged. Thanks for the efforts, Galen and Filip! We should be ready to kick off a new release for StateFun with the Flink version upgrade. I'll cut off a release branch now on apache/flink-statefun for release-3.3.x to move things forward. @Galen, @Filip

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-01 Thread Jing Ge
Hi all, I am totally fine to do step 2 with 1.17. It would give us more room to do some breaking changes if we would do it with 1.18. @Danny Thanks for the hint. Commonly, all related interfaces/classes should be graduated too. Classes like SingleThreadMultiplexSourceReaderBase and

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-11-01 Thread Jing Ge
Congrats, Danny! Best regards, Jing On Tue, Nov 1, 2022 at 11:42 AM Hamdy, Ahmed wrote: > Congratulations, Danny! > Best, > Ahmed > > On 01/11/2022, 09:51, "Yuxin Tan" wrote: > > CAUTION: This email originated from outside of the organization. Do > not click links or open attachments

Re: [DISCUSS] FLIP-264 Extract BaseCoordinatorContext

2022-11-01 Thread Maximilian Michels
Thanks Steven! My confusion stemmed from the lack of context in the FLIP. The first version did not lay out how the refactoring would be used down the line, e.g. by the ShuffleCoordinator. The OperatorCoordinator API is a non-public API and before reading the code, I wasn't even aware how exactly

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-11-01 Thread Hamdy, Ahmed
Congratulations, Danny! Best, Ahmed On 01/11/2022, 09:51, "Yuxin Tan" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Congrats, Danny! Best,

Re: [DISCUSS] Delete useless branches from Flink repository

2022-11-01 Thread Leonard Xu
Thanks Yun Tang for joining the discussion. I’ve deleted these branches with same name tag except release-1.14.6-rc2 which has no same name tag. release-1.12.3-rc1 release-1.13.2-rc2 release-1.14.3-rc1 release-1.15.0-rc1 release-1.14.6-rc2 Best, Leonard > > Hi Leonard, > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-11-01 Thread Yuxin Tan
Congrats, Danny! Best, Yuxin Guowei Ma 于2022年11月1日周二 16:36写道: > Congratulations Danny! > Best, > Guowei > > > On Tue, Nov 1, 2022 at 2:20 PM weijie guo > wrote: > > > Congratulations Danny! > > > > Best regards, > > > > Weijie > > > > > > Maximilian Michels 于2022年10月13日周四 21:41写道: > > > > >

[jira] [Created] (FLINK-29836) PulsarUnorderedSourceITCase failed due to an expected job restart not happening

2022-11-01 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29836: - Summary: PulsarUnorderedSourceITCase failed due to an expected job restart not happening Key: FLINK-29836 URL: https://issues.apache.org/jira/browse/FLINK-29836

[jira] [Created] (FLINK-29835) BlobServer fails to provide artifacts

2022-11-01 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29835: - Summary: BlobServer fails to provide artifacts Key: FLINK-29835 URL: https://issues.apache.org/jira/browse/FLINK-29835 Project: Flink Issue Type: Bug

[SUMMARY] Flink 1.17 Release Sync 11/1/2022

2022-11-01 Thread Qingsheng Ren
Hi devs and users, I'd like to share some highlights about the 1.17 release sync on 11/1/2022. - The release sync is scheduled for biweekly Tuesdays at 9am (Central European Standard Time) / 4pm (China Standard Time). - Retrospective for 1.16: a discussion [1] is opened by Matthias for

[jira] [Created] (FLINK-29834) Clear static Jackson TypeFactory cache on CL release

2022-11-01 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29834: Summary: Clear static Jackson TypeFactory cache on CL release Key: FLINK-29834 URL: https://issues.apache.org/jira/browse/FLINK-29834 Project: Flink

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-01 Thread Piotr Nowojski
Thanks Martijn and David, And what about the FlinkKafkaProducer? In order to migrate it, the user has to make sure that the transactions stored on the state are committed, and that there are no lingering/pending transactions (lingering transactions are blocking further reads to be readable until

[jira] [Created] (FLINK-29833) Improve PyFlink support in Windows

2022-11-01 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-29833: Summary: Improve PyFlink support in Windows Key: FLINK-29833 URL: https://issues.apache.org/jira/browse/FLINK-29833 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29832) Refactor default database name in flink table store

2022-11-01 Thread Shammon (Jira)
Shammon created FLINK-29832: --- Summary: Refactor default database name in flink table store Key: FLINK-29832 URL: https://issues.apache.org/jira/browse/FLINK-29832 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-11-01 Thread Guowei Ma
Congratulations Danny! Best, Guowei On Tue, Nov 1, 2022 at 2:20 PM weijie guo wrote: > Congratulations Danny! > > Best regards, > > Weijie > > > Maximilian Michels 于2022年10月13日周四 21:41写道: > > > Congratulations Danny! Well deserved :) > > > > -Max > > > > On Thu, Oct 13, 2022 at 2:40 PM Yang

[jira] [Created] (FLINK-29831) Multiple Hive tests are failing

2022-11-01 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29831: -- Summary: Multiple Hive tests are failing Key: FLINK-29831 URL: https://issues.apache.org/jira/browse/FLINK-29831 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29830) PulsarSinkITCase$DeliveryGuaranteeTest.writeRecordsToPulsar failed

2022-11-01 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29830: -- Summary: PulsarSinkITCase$DeliveryGuaranteeTest.writeRecordsToPulsar failed Key: FLINK-29830 URL: https://issues.apache.org/jira/browse/FLINK-29830 Project:

Re: SQL Gateway and SQL Client

2022-11-01 Thread Alexey Leonov-Vendrovskiy
Thanks Shengkai. > We don't have any detailed plan about this. But I know Livy has a similar feature. How can we check with Livy on this? Back to the SQL client: is this the master issue tracking enabling SQL Client <-> Gateway connection? https://issues.apache.org/jira/browse/FLINK-29751

[jira] [Created] (FLINK-29829) align explain results in different platforms

2022-11-01 Thread Yubin Li (Jira)
Yubin Li created FLINK-29829: Summary: align explain results in different platforms Key: FLINK-29829 URL: https://issues.apache.org/jira/browse/FLINK-29829 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-29828) Support to read data from table with given snapshot id

2022-11-01 Thread Shammon (Jira)
Shammon created FLINK-29828: --- Summary: Support to read data from table with given snapshot id Key: FLINK-29828 URL: https://issues.apache.org/jira/browse/FLINK-29828 Project: Flink Issue Type:

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-01 Thread Martijn Visser
Hi all, @Piotr When FlinkKafkaConsumer was marked as deprecated, the migration steps were included in the release notes: https://nightlies.apache.org/flink/flink-docs-master/release-notes/flink-1.14/#flink-24055httpsissuesapacheorgjirabrowseflink-24055 Scrolling up a bit shows how move from

[jira] [Created] (FLINK-29827) [Connector][AsyncSinkWriter] Checkpointed states block writer from sending records

2022-11-01 Thread Hoang Tri Tam (Jira)
Hoang Tri Tam created FLINK-29827: - Summary: [Connector][AsyncSinkWriter] Checkpointed states block writer from sending records Key: FLINK-29827 URL: https://issues.apache.org/jira/browse/FLINK-29827

[jira] [Created] (FLINK-29826) flink-sql-connector-hbase-1.4 netty class not found, because of shade not work

2022-11-01 Thread xuyong (Jira)
xuyong created FLINK-29826: -- Summary: flink-sql-connector-hbase-1.4 netty class not found, because of shade not work Key: FLINK-29826 URL: https://issues.apache.org/jira/browse/FLINK-29826 Project: Flink

Re: [DISCUSS] Remove FlinkKafkaConsumer and FlinkKafkaProducer in the master for 1.17 release

2022-11-01 Thread David Anderson
> > [H]ow one can migrate from the > FlinkKafkaConsumer/FlinkKafkaProducer to KafkaSource/KafkaSink, while > preserving exactly-once guarantees etc? The responses from Fabian Paul in [1] and [2] address the question of how to handle the migration in terms of managing the state (where the short

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-11-01 Thread weijie guo
Congratulations Danny! Best regards, Weijie Maximilian Michels 于2022年10月13日周四 21:41写道: > Congratulations Danny! Well deserved :) > > -Max > > On Thu, Oct 13, 2022 at 2:40 PM Yang Wang wrote: > > > Congratulations Danny! > > > > Best, > > Yang > > > > Hang Ruan 于2022年10月13日周四 10:58写道: > > >