Re: [DISCUSS] FLIP-268: Rack Awareness for Kafka Sources

2022-11-10 Thread Martijn Visser
Hi Yanfei, The version for Kafka Clients has been upgraded to 3.2.3 since 1.16 via FLINK-29513 [1] Best regards, Martijn [1] https://issues.apache.org/jira/browse/FLINK-29513 On Fri, Nov 11, 2022 at 4:11 AM Yanfei Lei wrote: > Hi Jeremy, > > Thanks for the proposal. > I'm curious if this fea

[jira] [Created] (FLINK-29990) Unparsed SQL for SqlTableLike cannot be parsed correctly

2022-11-10 Thread Shuo Cheng (Jira)
Shuo Cheng created FLINK-29990: -- Summary: Unparsed SQL for SqlTableLike cannot be parsed correctly Key: FLINK-29990 URL: https://issues.apache.org/jira/browse/FLINK-29990 Project: Flink Issue Ty

[jira] [Created] (FLINK-29989) Enable FlameGraph for arbitrary thread on TaskManager

2022-11-10 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-29989: --- Summary: Enable FlameGraph for arbitrary thread on TaskManager Key: FLINK-29989 URL: https://issues.apache.org/jira/browse/FLINK-29989 Project: Flink Issue Type: Impro

[jira] [Created] (FLINK-29988) Improve upper case fields for hive metastore

2022-11-10 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-29988: Summary: Improve upper case fields for hive metastore Key: FLINK-29988 URL: https://issues.apache.org/jira/browse/FLINK-29988 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-29987) PartialUpdateITCase.testForeignKeyJo is unstable

2022-11-10 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-29987: Summary: PartialUpdateITCase.testForeignKeyJo is unstable Key: FLINK-29987 URL: https://issues.apache.org/jira/browse/FLINK-29987 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-268: Rack Awareness for Kafka Sources

2022-11-10 Thread Yanfei Lei
Hi Jeremy, Thanks for the proposal. I'm curious if this feature can adapt to the current kafka-client version in the connector. The rack awareness feature requires a version>=3.2.0 to use, while the kafka-client version of Kafka connector is 2.8.1. Will we upgrade the Kafka-client version first?

Re: SQL Gateway and SQL Client

2022-11-10 Thread Shengkai Fang
Hi, Jim. > how to pass additional headers when sending REST requests Could you share what headers do you want to send when using SQL Client? I think there are two cases we need to consider. Please correct me if I am wrong. # Case 1 If users wants to connect to the SQL Gateway with its password

[jira] [Created] (FLINK-29986) How to persist flink catalogs configuration?

2022-11-10 Thread Alvin Ge (Jira)
Alvin Ge created FLINK-29986: Summary: How to persist flink catalogs configuration? Key: FLINK-29986 URL: https://issues.apache.org/jira/browse/FLINK-29986 Project: Flink Issue Type: Improvement

[DISCUSS] FLIP-268: Rack Awareness for Kafka Sources

2022-11-10 Thread Jeremy DeGroot
Kafak has a rack awareness feature that allows brokers and consumers to communicate about the rack (or AWS Availability Zone) they're located in. Reading from a local broker can save money in bandwidth and improve latency for your consumers. This improvement proposes that a Kafka Consumer could be

Re: SQL Gateway and SQL Client

2022-11-10 Thread Jim Hughes
Hi Yu Zelin, I have read through your draft and it looks good. I am new to Flink, so I haven't learned about everything which needs to be done yet. One of the considerations that I'm interested in understanding is how to pass additional headers when sending REST requests. From looking at the co

Re: [DISCUSS] Release Flink 1.15.3

2022-11-10 Thread Martijn Visser
Hi Fabian, I've added 1.15.4 as a new release version. Thanks, Martijn On Thu, Nov 10, 2022 at 5:18 PM Fabian Paul wrote: > I conclude that the community has accepted another release, and I will open > the voting thread shortly. Can someone with PMC rights add 1.15.4 as a new > release version

[jira] [Created] (FLINK-29985) SlotTable not close on TM termination

2022-11-10 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-29985: - Summary: SlotTable not close on TM termination Key: FLINK-29985 URL: https://issues.apache.org/jira/browse/FLINK-29985 Project: Flink Issue Type: B

[jira] [Created] (FLINK-29984) Flink Histogram not emitting min and max when using Prometheus Reporter

2022-11-10 Thread Lim Qing Wei (Jira)
Lim Qing Wei created FLINK-29984: Summary: Flink Histogram not emitting min and max when using Prometheus Reporter Key: FLINK-29984 URL: https://issues.apache.org/jira/browse/FLINK-29984 Project: Flin

[VOTE] Release 1.15.3, release candidate #1

2022-11-10 Thread Fabian Paul
Hi everyone, Please review and vote on the release candidate #1 for the version 1.15.3, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: - JIRA release notes [1], - t

Re: [DISCUSS] Release Flink 1.15.3

2022-11-10 Thread Fabian Paul
I conclude that the community has accepted another release, and I will open the voting thread shortly. Can someone with PMC rights add 1.15.4 as a new release version in JIRA [1] so that I can update the still open tickets? Best, Fabian [1] https://issues.apache.org/jira/plugins/servlet/project-c

Re: ASF Slack

2022-11-10 Thread Ryan Skraba
I have to admit, I also (weakly) prefer a single workspace where possible. It's easy to miss (or just not look at) the apache-flink workspace because I didn't think of it. The spam and spam account issues are probably inevitable for any slack workspace as it grows, and we can probably reasonably e

[jira] [Created] (FLINK-29983) Table Store with Hive3 profile lacks hive-standalone-metastore dependency

2022-11-10 Thread Jane Chan (Jira)
Jane Chan created FLINK-29983: - Summary: Table Store with Hive3 profile lacks hive-standalone-metastore dependency Key: FLINK-29983 URL: https://issues.apache.org/jira/browse/FLINK-29983 Project: Flink

Re: [ACCOUNCE] Apache Flink Elasticsearch Connector 3.0.0 released

2022-11-10 Thread Ryan Skraba
Excellent news -- welcome to the new era of easier, more timely and more feature-rich releases for everyone! Great job! Ryan On Thu, Nov 10, 2022 at 3:15 PM Leonard Xu wrote: > Thanks Chesnay and Martijn for the great work! I believe the > flink-connector-shared-utils[1] you built will help

Re: ASF Slack

2022-11-10 Thread Maximilian Michels
>On the other hand, could you explain a bit more about what are the problems / drawbacks that you see in the current Flink Slack? >- I assume having to join too many workspaces counts one I like the idea of having a single workspace for all ASF projects, similarly to how we share JIRA, mail server

[jira] [Created] (FLINK-29982) Move cassandra connector to dedicated repo

2022-11-10 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-29982: Summary: Move cassandra connector to dedicated repo Key: FLINK-29982 URL: https://issues.apache.org/jira/browse/FLINK-29982 Project: Flink Issue Type

Re: ASF Slack

2022-11-10 Thread Chesnay Schepler
https://issues.apache.org/jira/browse/INFRA-22573 On 10/11/2022 11:17, Martijn Visser wrote: It was discussed at the latest Apachecon conference by Infra during one of the lightning talks. If I recall correctly, it was primarily turned to invite-only due to spam. But definitely good to validate

Re: [ACCOUNCE] Apache Flink Elasticsearch Connector 3.0.0 released

2022-11-10 Thread Leonard Xu
Thanks Chesnay and Martijn for the great work! I believe the flink-connector-shared-utils[1] you built will help Flink connector developers a lot. Best, Leonard [1] https://github.com/apache/flink-connector-shared-utils > 2022年11月10日 下午9:53,Martijn Visser 写道: > > Really happy with the firs

Re: [ACCOUNCE] Apache Flink Elasticsearch Connector 3.0.0 released

2022-11-10 Thread Martijn Visser
Really happy with the first externalized connector for Flink. Thanks a lot to all of you involved! On Thu, Nov 10, 2022 at 12:51 PM Chesnay Schepler wrote: > The Apache Flink community is very happy to announce the release of > Apache Flink Elasticsearch Connector 3.0.0. > > Apache Flink® is an

[jira] [Created] (FLINK-29981) Improve WatermarkAssignerChangelogNormalizeTransposeRule

2022-11-10 Thread godfrey he (Jira)
godfrey he created FLINK-29981: -- Summary: Improve WatermarkAssignerChangelogNormalizeTransposeRule Key: FLINK-29981 URL: https://issues.apache.org/jira/browse/FLINK-29981 Project: Flink Issue Ty

[jira] [Created] (FLINK-29980) Wrap the HiveSource's bulkFormat to handle the partition keys

2022-11-10 Thread Aitozi (Jira)
Aitozi created FLINK-29980: -- Summary: Wrap the HiveSource's bulkFormat to handle the partition keys Key: FLINK-29980 URL: https://issues.apache.org/jira/browse/FLINK-29980 Project: Flink Issue Type

Re: [blog article] Howto migrate a real-life batch pipeline from the DataSet API to the DataStream API

2022-11-10 Thread Jing Ge
Hi Etienne, Nice blog! Thanks for sharing! Best regards, Jing On Wed, Nov 9, 2022 at 5:49 PM Etienne Chauchot wrote: > Hi Yun Gao, > > FYI I just updated the article after your review: > https://echauchot.blogspot.com/2022/11/flink-howto-migrate-real-life-batch.html > > Best > > Etienne > Le

[GitHub] [flink-connector-shared-utils] zentol merged pull request #1: [FLINK-29472] Add first version of release scripts

2022-11-10 Thread GitBox
zentol merged PR #1: URL: https://github.com/apache/flink-connector-shared-utils/pull/1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@

[ACCOUNCE] Apache Flink Elasticsearch Connector 3.0.0 released

2022-11-10 Thread Chesnay Schepler
The Apache Flink community is very happy to announce the release of Apache Flink Elasticsearch Connector 3.0.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available f

[jira] [Created] (FLINK-29979) connector_artifact should only work for stable releases

2022-11-10 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29979: Summary: connector_artifact should only work for stable releases Key: FLINK-29979 URL: https://issues.apache.org/jira/browse/FLINK-29979 Project: Flink

Re: [VOTE] Release flink-shaded 16.1, release candidate #1

2022-11-10 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PR On Tue, Nov 8, 2022 at 11:48 AM Chesnay Schepler wrote: > Hi everyone, > Please review and vote on the release candid

Re: ASF Slack

2022-11-10 Thread Martijn Visser
It was discussed at the latest Apachecon conference by Infra during one of the lightning talks. If I recall correctly, it was primarily turned to invite-only due to spam. But definitely good to validate that. On Thu, Nov 10, 2022 at 11:09 AM Maximilian Michels wrote: > The registration problem s

Re: ASF Slack

2022-11-10 Thread Maximilian Michels
The registration problem should be solvable. Maybe it is due to the Slack pricing model that the ASF Slack is invite-only. I'll ping the community mailing list. Have these issues at any point been discussed with the ASF? I feel like this is one of the examples where a community spins off to do its

Re: [DISCUSS] Repeatable cleanup of checkpoint data

2022-11-10 Thread Matthias Pohl
Thanks for sharing your opinions on the proposal. The concerns sound reasonable. I guess, I'm going to follow-up on Chesnay's idea about combining multiple requests into one for the k8s implementation. Having a performance test for the k8s API server access sounds like a good idea, too. Both action

[jira] [Created] (FLINK-29978) FlinkKafkaInternalProducer not compatible with kafka-client-3.3.x

2022-11-10 Thread Owen Lee (Jira)
Owen Lee created FLINK-29978: Summary: FlinkKafkaInternalProducer not compatible with kafka-client-3.3.x Key: FLINK-29978 URL: https://issues.apache.org/jira/browse/FLINK-29978 Project: Flink Is

[jira] [Created] (FLINK-29977) Kafka connector not compatible with kafka-clients 3.3x

2022-11-10 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29977: Summary: Kafka connector not compatible with kafka-clients 3.3x Key: FLINK-29977 URL: https://issues.apache.org/jira/browse/FLINK-29977 Project: Flink

[jira] [Created] (FLINK-29976) The cron connectors test run out of given timeout in Azure

2022-11-10 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-29976: -- Summary: The cron connectors test run out of given timeout in Azure Key: FLINK-29976 URL: https://issues.apache.org/jira/browse/FLINK-29976 Project: Flink Issue

[jira] [Created] (FLINK-29975) Let hybrid full spilling strategy supports partition reuse

2022-11-10 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-29975: -- Summary: Let hybrid full spilling strategy supports partition reuse Key: FLINK-29975 URL: https://issues.apache.org/jira/browse/FLINK-29975 Project: Flink Issue

[jira] [Created] (FLINK-29974) Session jobs in FINISHED/FAILED state cannot be upgraded

2022-11-10 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-29974: -- Summary: Session jobs in FINISHED/FAILED state cannot be upgraded Key: FLINK-29974 URL: https://issues.apache.org/jira/browse/FLINK-29974 Project: Flink Issue Ty

[jira] [Created] (FLINK-29973) connector_artifact should append Flink minor version

2022-11-10 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29973: Summary: connector_artifact should append Flink minor version Key: FLINK-29973 URL: https://issues.apache.org/jira/browse/FLINK-29973 Project: Flink

[jira] [Created] (FLINK-29972) Pin Flink docs to Elasticsearch Connector 3.0.0

2022-11-10 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29972: Summary: Pin Flink docs to Elasticsearch Connector 3.0.0 Key: FLINK-29972 URL: https://issues.apache.org/jira/browse/FLINK-29972 Project: Flink Issue

[jira] [Created] (FLINK-29971) Hbase sink will lose data at extreme case

2022-11-10 Thread wenchao.wu (Jira)
wenchao.wu created FLINK-29971: -- Summary: Hbase sink will lose data at extreme case Key: FLINK-29971 URL: https://issues.apache.org/jira/browse/FLINK-29971 Project: Flink Issue Type: Bug