Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

2023-04-24 Thread Jing Ge via user
Thanks Chesnay for working on this. Would you like to share more info about the JDK bug? Best regards, Jing On Mon, Apr 24, 2023 at 11:39 AM Chesnay Schepler wrote: > As it turns out Kryo isn't a blocker; we ran into a JDK bug. > > On 31/03/2023 08:57, Chesnay Schepler wrote: > > > https://gith

Flink-kubernetes-operator with Argocd

2023-04-24 Thread Sweta Kalakuntla via user
Hi, Can anyone who has implemented flink-kubernetes-operator with Argocd share an example code? Thank you, Sweta --

Re: State bootstrapping for Flink SQL / Table API jobs

2023-04-24 Thread Илья Соин
Thank you, Shammon FY-- Sincerely,Ilya SoinOn 24 Apr 2023, at 15:19, Shammon FY wrote:Thanks Илья, there's already a FLIP [1] and discussion thread [2] about hybrid source. You can follow the progress and welcome to participate in the discussion.[1] https://cwiki.apache.org/confluence/pages/viewp

Re: State bootstrapping for Flink SQL / Table API jobs

2023-04-24 Thread Shammon FY
Thanks Илья, there's already a FLIP [1] and discussion thread [2] about hybrid source. You can follow the progress and welcome to participate in the discussion. [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=235836225 [2] https://lists.apache.org/thread/nbf3skopy3trtj37jcovmt

Re: [Flink operator] Flink Autoscale - Limit the max number of scale ups

2023-04-24 Thread Gyula Fóra
Hi! Please opena JIRA ticket with the details of your log, config and operator version and we will take a look! Thanks Gyula On Mon, Apr 24, 2023 at 2:04 PM Sriram Ganesh wrote: > Hi, > > I am trying the autoscale provided by the operator. I found that Autoscale > keeps happening even after re

[Flink operator] Flink Autoscale - Limit the max number of scale ups

2023-04-24 Thread Sriram Ganesh
Hi, I am trying the autoscale provided by the operator. I found that Autoscale keeps happening even after reaching max-parallelism. I have a question. How can we set the limit for the scale-up process? Because in my cluster it reached the max limit. So, there won't be any more resources available

[ANNOUNCE] Apache flink-connector-aws 4.1.0 for Flink 1.17 released

2023-04-24 Thread Danny Cranmer
The Apache Flink community is very happy to announce the release of Apache flink-connector-aws 4.1.0 for Apache Flink 1.17. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is avai

[ANNOUNCE] Apache flink-connector-mongodb 1.0.1 released

2023-04-24 Thread Danny Cranmer
The Apache Flink community is very happy to announce the release of Apache flink-connector-mongodb 1.0.1 for Apache Flink 1.16 and 1.17. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The re

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

2023-04-24 Thread Chesnay Schepler
As it turns out Kryo isn't a blocker; we ran into a JDK bug. On 31/03/2023 08:57, Chesnay Schepler wrote: https://github.com/EsotericSoftware/kryo/wiki/Migration-to-v5#migration-guide Kroy themselves state that v5 likely can't read v2 data. However, both versions can be on the classpath withou

Re: State bootstrapping for Flink SQL / Table API jobs

2023-04-24 Thread Илья Соин
Hi Shammon FY,I haven’t tried it because AFIK it’s only available in the DataStream API, while our job is in SQL. I’m thinking to write a custom HybridDynamicTableSource which will use HybridSource under the hood. This should allow to bootstrap any SQL / Table API job. Maybe it’s something worth ad