Re: [DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread Chesnay Schepler
Thanks everyone; I have opened a PR: https://github.com/apache/flink/pull/20526 On 10/08/2022 04:16, Xingbo Huang wrote: I'm not sure if this kafka upgrade will bring other unknown problems, but if this upgrade can help us solve known critical bugs, the sooner the upgrade, the better. Before

[jira] [Created] (FLINK-28898) ChangelogRecoverySwitchStateBackendITCase.testSwitchFromEnablingToDisablingWithRescalingOut failed

2022-08-09 Thread Xingbo Huang (Jira)
Xingbo Huang created FLINK-28898: Summary: ChangelogRecoverySwitchStateBackendITCase.testSwitchFromEnablingToDisablingWithRescalingOut failed Key: FLINK-28898 URL:

[jira] [Created] (FLINK-28897) Fail to use udf in added jar when enabling checkpoint

2022-08-09 Thread Liu (Jira)
Liu created FLINK-28897: --- Summary: Fail to use udf in added jar when enabling checkpoint Key: FLINK-28897 URL: https://issues.apache.org/jira/browse/FLINK-28897 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28896) Test Flink Release 1.16

2022-08-09 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-28896: Summary: Test Flink Release 1.16 Key: FLINK-28896 URL: https://issues.apache.org/jira/browse/FLINK-28896 Project: Flink Issue Type: Improvement

RE: Re: Re: Re: Re: [DISCUSS] FLIP-239: Port JDBC Connector Source to FLIP-27

2022-08-09 Thread Roc Marshal
Hi, Martijn, Boto. I just complete the design of the source and the skeleton design of the sink at present. I think the current Flip is missing part of the sink design. @Boto Would you like to complete the sink part directly on the FLIP page? Looking forward to your reply. On 2022/08/01

Re: [DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread Xingbo Huang
I'm not sure if this kafka upgrade will bring other unknown problems, but if this upgrade can help us solve known critical bugs, the sooner the upgrade, the better. Before cutting release-1.16 branch, we will still have enough time to test the impact. So I'm +1 for including this fix in 1.16.0.

[jira] [Created] (FLINK-28895) Eliminate the map to convert RowData to Row before RowData FileSink

2022-08-09 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-28895: - Summary: Eliminate the map to convert RowData to Row before RowData FileSink Key: FLINK-28895 URL: https://issues.apache.org/jira/browse/FLINK-28895 Project: Flink

Re: Flink slack

2022-08-09 Thread yuxia
You can click this Salck invite link: https://join.slack.com/t/apache-flink/shared_invite/zt-1e0kgxwir-Nme4eIt0SMWUSOYKAH2iow Best regards, Yuxia - 原始邮件 - 发件人: "DavidLiu" 收件人: "dev" 发送时间: 星期三, 2022年 8 月 10日 上午 9:20:31 主题: Flink slack Hi, all Can anybody kindly invite me to Apache

Re: Flink slack

2022-08-09 Thread Xintong Song
Hi David, I tried to invite you, but unfortunately failed. It seems for some reason Slack does not support NetEase email accounts (this happened before for people with @163.com email). Do you have another email account? Best, Xintong On Wed, Aug 10, 2022 at 9:21 AM DavidLiu wrote: > Hi,

Flink slack

2022-08-09 Thread DavidLiu
Hi, all Can anybody kindly invite me to Apache Flink Slack? Thanks & BR David Liu

Re: [DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread Mason Chen
+1 We don't have a reproducible test in Flink CI to tell if the issue is definitely solved. However, bumping the version doesn't make matters worse then the current state. Best, Mason On Tue, Aug 9, 2022 at 10:56 AM David Anderson wrote: > I'm in favor of adopting this fix in 1.16.0. > > +1 >

Re: [DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread David Anderson
I'm in favor of adopting this fix in 1.16.0. +1 On Tue, Aug 9, 2022 at 7:13 AM tison wrote: > +1 > > This looks reasonable. > > Best, > tison. > > > Thomas Weise 于2022年8月9日周二 21:33写道: > > > +1 for bumping the Kafka dependency. > > > > Flink X.Y.0 releases require thorough testing, so

Re: [DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread tison
+1 This looks reasonable. Best, tison. Thomas Weise 于2022年8月9日周二 21:33写道: > +1 for bumping the Kafka dependency. > > Flink X.Y.0 releases require thorough testing, so considering the severity > of the problem this is still good timing, even that close to the first RC. > > Thanks for bringing

Re: [DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread Thomas Weise
+1 for bumping the Kafka dependency. Flink X.Y.0 releases require thorough testing, so considering the severity of the problem this is still good timing, even that close to the first RC. Thanks for bringing this up. Thomas On Tue, Aug 9, 2022 at 7:51 AM Chesnay Schepler wrote: > Hello, > >

Re: [DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread Galen Warren
I would love to see this issue resolved in 1.16.0. Thanks. On Tue, Aug 9, 2022, 7:50 AM Chesnay Schepler wrote: > Hello, > > The Kafka upgrade in 1.15.0 resulted in a regression > (https://issues.apache.org/jira/browse/FLINK-28060) where offsets are > not committed to Kafka, impeding monitoring

[jira] [Created] (FLINK-28894) Add Transformer for Interaction

2022-08-09 Thread weibo zhao (Jira)
weibo zhao created FLINK-28894: -- Summary: Add Transformer for Interaction Key: FLINK-28894 URL: https://issues.apache.org/jira/browse/FLINK-28894 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-28893) Add conv function supported in SQL & Table API

2022-08-09 Thread jackylau (Jira)
jackylau created FLINK-28893: Summary: Add conv function supported in SQL & Table API Key: FLINK-28893 URL: https://issues.apache.org/jira/browse/FLINK-28893 Project: Flink Issue Type:

[DISCUSS] Bump Kafka to 3.2.1 for 1.16.0

2022-08-09 Thread Chesnay Schepler
Hello, The Kafka upgrade in 1.15.0 resulted in a regression (https://issues.apache.org/jira/browse/FLINK-28060) where offsets are not committed to Kafka, impeding monitoring and the starting offsets functionality of the connector. This has been fixed a about a week ago in Kafka 3.2.1. The

[SUMMARY] Flink 1.16 release sync of 2022-08-09

2022-08-09 Thread Xingbo Huang
Hi everyone, I would like to give you a brief update of the Flink 1.16 release sync meating of 2022-08-09. * Currently, we have 40 features that have been completed for this release and 6 features are still expected to make it (PS: Most of them are already reviewed and are just waiting for the

[jira] [Created] (FLINK-28892) Update NOTICE for flink-kubernetes-operator 1.1.1

2022-08-09 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28892: -- Summary: Update NOTICE for flink-kubernetes-operator 1.1.1 Key: FLINK-28892 URL: https://issues.apache.org/jira/browse/FLINK-28892 Project: Flink Issue Type:

[jira] [Created] (FLINK-28891) Upgrade google-cloud-libraries-bom version to 25.0.0

2022-08-09 Thread Bilna (Jira)
Bilna created FLINK-28891: - Summary: Upgrade google-cloud-libraries-bom version to 25.0.0 Key: FLINK-28891 URL: https://issues.apache.org/jira/browse/FLINK-28891 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28890) Incorrect semantic of latestLoadTime in CachingLookupFunction and CachingAsyncLookupFunction

2022-08-09 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28890: - Summary: Incorrect semantic of latestLoadTime in CachingLookupFunction and CachingAsyncLookupFunction Key: FLINK-28890 URL: https://issues.apache.org/jira/browse/FLINK-28890

Re: [SUMMARY] Flink 1.16 release sync of 2022-08-02

2022-08-09 Thread Robert Metzger
Thanks. I had the old invite link in my calendar. I'll join next week again ;)

[jira] [Created] (FLINK-28889) Hybrid shuffle writes multiple copies of broadcast data

2022-08-09 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-28889: -- Summary: Hybrid shuffle writes multiple copies of broadcast data Key: FLINK-28889 URL: https://issues.apache.org/jira/browse/FLINK-28889 Project: Flink Issue

[jira] [Created] (FLINK-28888) The statistics of HsResultPartition are not updated correctly

2022-08-09 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-2: -- Summary: The statistics of HsResultPartition are not updated correctly Key: FLINK-2 URL: https://issues.apache.org/jira/browse/FLINK-2 Project: Flink

[jira] [Created] (FLINK-28887) Fix the bug of custom metrics in Thread Mode

2022-08-09 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-28887: Summary: Fix the bug of custom metrics in Thread Mode Key: FLINK-28887 URL: https://issues.apache.org/jira/browse/FLINK-28887 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28886) Support HybridSource in Python DataStream API

2022-08-09 Thread Dian Fu (Jira)
Dian Fu created FLINK-28886: --- Summary: Support HybridSource in Python DataStream API Key: FLINK-28886 URL: https://issues.apache.org/jira/browse/FLINK-28886 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-28885) Improve LookupFunction to support different kinds of RowData as key row

2022-08-09 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28885: - Summary: Improve LookupFunction to support different kinds of RowData as key row Key: FLINK-28885 URL: https://issues.apache.org/jira/browse/FLINK-28885 Project:

Re: [SUMMARY] Flink 1.16 release sync of 2022-08-02

2022-08-09 Thread Xingbo Huang
Martijn has changed the previous meeting link in the 1.16 doc. I'll post the summary of today's release sync later. Chesnay Schepler 于2022年8月9日周二 15:40写道: > The sync did happen; it was reachable under the same google meet link in > the 1.16 doc as usual. > > On 09/08/2022 09:31, Robert Metzger

[GitHub] [flink-connector-rabbitmq] pscls commented on pull request #1: [FLINK-20628] RabbitMQ Connector using FLIP-27 Source API

2022-08-09 Thread GitBox
pscls commented on PR #1: URL: https://github.com/apache/flink-connector-rabbitmq/pull/1#issuecomment-1209062942 > @pscls The CI fails due to spotless; can you fix that? (By running `mvn spotless:apply`) @MartijnVisser I've nothing to commit when running `mvn spotless:apply`.

Re: [SUMMARY] Flink 1.16 release sync of 2022-08-02

2022-08-09 Thread Chesnay Schepler
The sync did happen; it was reachable under the same google meet link in the 1.16 doc as usual. On 09/08/2022 09:31, Robert Metzger wrote: Thanks for the summary. I tried joining the sync today, but nobody joined. On the Flink Slack, Martijn's status is set to vacation, so I guess the meeting

[jira] [Created] (FLINK-28884) HsSubpartitionView should be initialized to a notifiable state.

2022-08-09 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-28884: -- Summary: HsSubpartitionView should be initialized to a notifiable state. Key: FLINK-28884 URL: https://issues.apache.org/jira/browse/FLINK-28884 Project: Flink

Re: [SUMMARY] Flink 1.16 release sync of 2022-08-02

2022-08-09 Thread Robert Metzger
Thanks for the summary. I tried joining the sync today, but nobody joined. On the Flink Slack, Martijn's status is set to vacation, so I guess the meeting didn't happen today? It seems that the pulsar blocker (FLINK-27399) is still open, but the PR seems to make progress. On Wed, Aug 3, 2022 at

[jira] [Created] (FLINK-28883) Report hive tasks' file number, total number and total size to metastore

2022-08-09 Thread Liu (Jira)
Liu created FLINK-28883: --- Summary: Report hive tasks' file number, total number and total size to metastore Key: FLINK-28883 URL: https://issues.apache.org/jira/browse/FLINK-28883 Project: Flink