Flink 1.18 support for flink stateful functions

2024-04-12 Thread Deshpande, Omkar via user
Hello, Is there a plan to add support for flink 1.18 in flink stateful function? Also, generally the stateful functions seem to be slow and lag behind the flink release cycle. Is the stateful function project going to be actively maintained? Thanks, Omkar

High Availability on Kubernetes

2021-10-25 Thread Deshpande, Omkar
Hello, We are running flink on Kubernetes(Standalone) in application cluster mode. The job manager is deployed as a deployment. We only deploy one instance/replica of job manager. So, the leader election service is not required. And we have set flink task execution retries to infinite. Do we

Re: rpc invocation exceeds the maximum akka framesize

2021-09-28 Thread Deshpande, Omkar
Is the akka framesize a function of broadcast size? From: Deshpande, Omkar Sent: Monday, September 27, 2021 6:31 PM To: user@flink.apache.org Cc: Benenson, Mikhail ; Hwang, Nick ; Canchi, Srivathsan Subject: rpc invocation exceeds the maximum akka framesize

rpc invocation exceeds the maximum akka framesize

2021-09-27 Thread Deshpande, Omkar
Hello, We run a lot of flink applications. Some of them sometimes run into this error on Job Manager- The rpc invocation size exceeds the maximum akka framesize After we increase the framesize the application starts working again. What factors determine the akka framesize? We sometimes see

Rocksdb - org.apache.flink.util.SerializedThrowable : bad entry in block

2021-01-26 Thread Deshpande, Omkar
Hello, I am using flink 1.9 with beam 2.26 and rocksdb state backend. I am getting this exception - org.apache.flink.util.SerializedThrowable: Caught exception while processing timer. at

Flink taskmanager id

2021-01-07 Thread Deshpande, Omkar
Hello, I use flink on kubernetes. And the taskmanagers get assigned random uuids. Is there a way to explicitly configure them to use hostnames instead? Omkar

Re: flink checkpoint timeout

2020-09-15 Thread Deshpande, Omkar
nstead of taskmanager.heap.size From: Deshpande, Omkar Sent: Monday, September 14, 2020 6:23 PM To: user@flink.apache.org Subject: flink checkpoint timeout This email is from an external sender. Hello, I recently upgraded from flink 1.9 to 1.10. The checkpointing succeeds

flink checkpoint timeout

2020-09-14 Thread Deshpande, Omkar
Hello, I recently upgraded from flink 1.9 to 1.10. The checkpointing succeeds first couple of times and then starts failing because of timeouts. The checkpoint time grows with every checkpoint and starts exceeding 10 minutes. I do not see any exceptions in the logs. I have enabled debug

Same kafka partition being consumed by multiple task managers.

2020-08-20 Thread Deshpande, Omkar
Hello, I am running a streaming Beam app with the Flink runner(java). * Beam 2.19 * Flink 1.9 Checkpoints and savepoints are configured to go to s3 and HA is enabled using Zookeeper. I was running the app with 3 task managers. I took a savepoint and started the app with 6 task

allowNonRestoredState: metadata file in checkpoint dir missing

2020-07-31 Thread Deshpande, Omkar
Hello, When deleting an operator we run our application with --allowNonRestoredState=true, as described in the documentation. When running with this

Re: Stopping flink application with /jobs/:jobid/savepoints or /jobs/:jobid/stop

2020-06-09 Thread Deshpande, Omkar
From: Kostas Kloudas Sent: Tuesday, June 9, 2020 4:48 AM To: Deshpande, Omkar Cc: user@flink.apache.org ; Hwang, Nick ; Benenson, Mikhail ; LeVeck, Matt ; Kathula, Sandeep Subject: Re: Stopping flink application with /jobs/:jobid/savepoints or /jobs/:jobid/stop This email is from an externa

Stopping flink application with /jobs/:jobid/savepoints or /jobs/:jobid/stop

2020-06-09 Thread Deshpande, Omkar
Hello, When I try to stop the job with /jobs/:jobid/stop REST endpoint, the state gets drained, even if I pass {"drain":false} in the body of the post request. Is the value of drain flag true