Re: Unable to run pyflink job - NetUtils getAvailablePort Error

Hi Xingbo I have double checked on this, both the flink and pyflink versions that i have are 1.14.4 on Jobmanager and task manager. However, I still get this error. Thanks Ramana On Tue, Sep 6, 2022, 14:23 Xingbo Huang wrote: > Hi Raman, > > This problem comes from the inconsistency between

Re: Flink upgrade path

Hi, Alexey. You could check the state compatibility in the compatibility table. The page includes how to upgrade and whether it is compatible among different versions. [1] https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/upgrading/#compatibility-table On Wed, Sep 7, 2022 at 7:0

[Flink Kubernetes Operator] FlinkSessionJob crd spec jarURI

Hi, Have a session cluster deployed in kubernetes. Trying to submit a job following the example given in docs. When I give 1) spec.job.jarURI: local:///opt/flink/examples/streaming/StateMachineExample.jar getting Error: org.apache.flink.core.fs.UnsupportedFileSystemSchemeException: Could not fi

Flink upgrade path

Hello, Can I upgade from 1.13.6 directly to 1.15.2 skipping 1.14.x ? Thanks, Alexey

serviceAccount permissions issue for high availability in operator 1.1

I am migrating a HA standalone Kubernetes app to use the Flink operator. The HA store is S3 using IRSA so the app needs to run with a serviceAccount that is authorized to access S3. In standalone mode HA worked once I gave the account permissions to edit configMaps. But when trying the operator wit

[ANNOUNCE] Apache Kyuubi (Incubating) released 1.6.0-incubating

Hi all, The Apache Kyuubi (Incubating) community is pleased to announce that Apache Kyuubi (Incubating) 1.6.0-incubating has been released! Apache Kyuubi (Incubating) is a distributed multi-tenant JDBC server for large-scale data processing and analytics, build on top of multiple compule e

Re: Slow Tests in Flink 1.15

Hi David, I guess, you're referring to [1]. But as Chesnay already pointed out in the previous thread: It would be helpful to get more insights into what exactly your tests are executing (logs, code, ...). That would help identifying the cause. > Can you give us a more complete stacktrace so we can

Re: Where will the state be stored in the taskmanager when using rocksdbstatebend？

Well, in that case, it is similar to the situation of hitting the limits of vertical scaling - you'll have to scale out horizontally. You could consider sizing down the number of CPU and RAM you allocate to each task manager, but instead increase their count (and your job's parallelism). It might c

Re: Unable to run pyflink job - NetUtils getAvailablePort Error

Hi Raman, This problem comes from the inconsistency between your flink version and pyflink version Best, Xingbo Ramana 于2022年9月6日周二 15:08写道： > Hello there, > > I have a pyflink setup of 1 : JobManager - 1 : Task Manager. > > Trying to run a pyflink job and no matter what i do, i get the follow

Flink Kinesis Connector EFO not working for cross-accounts

Hey there, Checking if Flink kinesis connector (using 1.15.2 version) EFO can do cross-accounts? My configuration looks like this: if (kinesisIamRole != null && !kinesisIamRole.isEmpty()) {  kinesisConsumerProps.put(AWSConfigConstants.AWS_ROLE_ARN, kinesisIamRole);  kinesisConsumerProps.put(AWSCo

Mixed up session aggregations for same key

Hi, I'm trying to migrate a KafkaStreams application to Flink (using DataStream API). The application consumes a high traffic (millions of events per second) Kafka topic and collects events into sessions keyed by id. To reduce the load on subsequent processing steps I want to output one event on

Unable to run pyflink job - NetUtils getAvailablePort Error

Hello there, I have a pyflink setup of 1 : JobManager - 1 : Task Manager. Trying to run a pyflink job and no matter what i do, i get the following error message. - The program finished with the following exception: org.apache.flink.client.program.ProgramInvocationException: The