Re: [EXTERNAL] Flink and Prometheus monitoring question

You could use “flink_jobmanager_numRunningJobs” to check the number of running jobs. Thanks From: Jesús Vásquez Date: Monday, December 16, 2019 at 12:47 PM To: "user@flink.apache.org" Subject: [EXTERNAL] Flink and Prometheus monitoring question Hi, I want to monitor Flink Streaming jobs using

Looking for help in configuring Swift as State Backend

Hi, I am looking for some help in configuring the Swift Fs as State Backend. I am unable to configure it, let me know if anyone has prior done this or knowledge to help me Do we still need to run an HDFS to use this feature ? Thanks, Shakir

Re: [EXTERNAL] Re: Looking for help in configuring Swift as State Backend

helping me Thanks From: Till Rohrmann Date: Wednesday, April 24, 2019 at 6:05 AM To: "PoolakkalMukkath, Shakir" Cc: "user@flink.apache.org" Subject: [EXTERNAL] Re: Looking for help in configuring Swift as State Backend Hi Shakir, have you checked out Flink's document

Avro SerializationSchema for Confluent Registry

Hi Till, Is there a Serialization schema for Kafka Producer when using Confluent Registry ? I am trying to publish to a topic which uses confluent registry and Avro schema. If there is one, please point me. Otherwise, what are the alternatives to do this ? Thanks Shakir

Re: [EXTERNAL] Re: Avro SerializationSchema for Confluent Registry

Thanks Dawid. That helps From: Dawid Wysakowicz Date: Friday, May 3, 2019 at 9:26 AM To: "PoolakkalMukkath, Shakir" , Till Rohrmann , "user@flink.apache.org" , Dominik Wosiński Subject: [EXTERNAL] Re: Avro SerializationSchema for Confluent Registry Hi Shakir, There

User Interface not showing the actual count received and produced

Hi Flink team, I am developing a flow which uses · FlinkKafkaConsumer010 to consume message from Kafka and · FlinkKinesisProducer to produce the results to Kinesis. In the user interface, I always see Bytes and Record received from Kafka is zero even though it is receiving event

Re: [EXTERNAL] Re: How to restart/recover on reboot?

Hi Tim,John, I do agree with the issue John mentioned and have the same problem. We can only start a standalone HA cluster with ./start-cluster.sh script. And then when there are failures, we can restart those components individually by calling jobmanager.sh/ jobmanager.sh. This works great B

Re: [EXTERNAL] Re: How to restart/recover on reboot?

Hi Nick, It works that way by explicitly setting the –host. I got mislead by the “only” word in doc and did not try. Thanks for the help Thanks, Shakir From: "Martin, Nick" Date: Tuesday, June 18, 2019 at 6:31 PM To: "PoolakkalMukkath, Shakir" , Till Rohrmann , John Smit

Delayed processing and Rate limiting

Hi Flink Team, I am looking for some direction/recommendation for below tasks 1. Delayed Processing: Having a use case where we need to process events after a time-delay from event time. Let’s say, the event happened at time t1, and it reached the Flink immediately, but I have to wait t1+2m

Re: [EXTERNAL] Re: Delayed processing and Rate limiting

: "PoolakkalMukkath, Shakir" , user Subject: [EXTERNAL] Re: Delayed processing and Rate limiting Hi Shakir, > Delayed Processing Maybe you can make use of the function ‘org.apache.flink.streaming.api.TimerService#registerProcessingTimeTimer’, check this doc for more details: https://

Re: [EXTERNAL] High availability flink job

I do not think you will have any problem with one broker going down as long as you have provided enough brokers on the bootstrap. Thanks, Shakir From: Vishwas Siravara Date: Sunday, September 15, 2019 at 2:52 PM To: user Subject: [EXTERNAL] High availability flink job Hi guys, I have a flink