Understanding webhook checks in flink operator

2022-09-09 Thread Prakhar Mathur
Hi, We are trying to install Flink Kubernetes operator v1.1.0. Few questions regarding the webhooks: - Is it necessary to install webhooks? If not, what can be the implications? - What type of validations and mutations does it support? Thanks Prakhar Mathur

Re: Left join query not clearing state after migrating from 1.9.0 to 1.14.3

2022-03-08 Thread Prakhar Mathur
deally, with detailed breakdown for the operators that seems problematic. > > Regards, > Roman > > On Fri, Mar 4, 2022 at 8:48 AM Prakhar Mathur wrote: > > > > Hi, > > > > Can someone kindly help and take a look at this? It's a major blocker > for us. >

Re: Left join query not clearing state after migrating from 1.9.0 to 1.14.3

2022-03-03 Thread Prakhar Mathur
Hi, Can someone kindly help and take a look at this? It's a major blocker for us. Thanks, Prakhar On Wed, Mar 2, 2022 at 2:11 PM Prakhar Mathur wrote: > Hello, > > We recently did a migration of our Flink jobs from version 1.9.0 to > 1.14.3. These jobs consume from Kafka

Left join query not clearing state after migrating from 1.9.0 to 1.14.3

2022-03-02 Thread Prakhar Mathur
. - Earlier in version 1.9.0, we were using org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer and now in 1.14.3 we have moved to the new Kafka Source. Any help will be highly appreciated as these are production jobs. Thanks Prakhar Mathur

[jira] [Commented] (FLINK-24135) Add support for metric group tags in StatsDReporter

2021-09-09 Thread Prakhar Mathur (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17412475#comment-17412475 ] Prakhar Mathur commented on FLINK-24135: How about adding support for filtering on metric level

[jira] [Commented] (FLINK-24135) Add support for metric group tags in StatsDReporter

2021-09-03 Thread Prakhar Mathur (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17409402#comment-17409402 ] Prakhar Mathur commented on FLINK-24135: This blacklisting is for metrics or for particular tags

[jira] [Created] (FLINK-24135) Add support for metric group tags in StatsDReporter

2021-09-02 Thread Prakhar Mathur (Jira)
Prakhar Mathur created FLINK-24135: -- Summary: Add support for metric group tags in StatsDReporter Key: FLINK-24135 URL: https://issues.apache.org/jira/browse/FLINK-24135 Project: Flink

[jira] [Created] (FLINK-24135) Add support for metric group tags in StatsDReporter

2021-09-02 Thread Prakhar Mathur (Jira)
Prakhar Mathur created FLINK-24135: -- Summary: Add support for metric group tags in StatsDReporter Key: FLINK-24135 URL: https://issues.apache.org/jira/browse/FLINK-24135 Project: Flink

[sympy] Personal Introduction

2020-11-05 Thread PRAKHAR MATHUR
Hello guys, I am Prakhar Mathur. I have been practising python for one year now. I am currently studying at IIT Goa . I am hoping to contribute in Sympy. Please can you help me with where should I start. It would be a great help. Regards, Prakhar Mathur. -- You received this message because

Re: Job Manager taking long time to upload job graph on remote storage

2020-09-04 Thread Prakhar Mathur
In another run you stated that it > would take 10s. > > Have you tried whether the same behaviour is observable with the latest > Flink version? > > Cheers, > Till > > On Fri, Sep 4, 2020 at 6:44 AM Prakhar Mathur wrote: > >> Yes, I will check that, but any po

Re: Job Manager taking long time to upload job graph on remote storage

2020-09-03 Thread Prakhar Mathur
> Cheers, > Till > > On Thu, Sep 3, 2020 at 6:23 PM Prakhar Mathur wrote: > >> We tried uploading the same blob from Job Manager k8s pod directly to GCS >> using gsutils and it took 2 seconds. The upload speed was 166.8 MiB/s. >> Thanks. >> >>

Re: Job Manager taking long time to upload job graph on remote storage

2020-09-03 Thread Prakhar Mathur
o your GCS bucket is from the machine you are running Flink on? > It should be enough to generate a 200 MB file and write it to GCS. Thanks a > lot for your help in debugging this matter. > > Cheers, > Till > > On Wed, Sep 2, 2020 at 1:04 PM Prakhar Mathur wrote: > >&g

Re: Job Manager taking long time to upload job graph on remote storage

2020-09-02 Thread Prakhar Mathur
ich are not needed (e.g. Flink dependencies which are > usually provided by the system). That way you could decrease the size of > the jar a bit. > > Cheers, > Till > > On Wed, Sep 2, 2020 at 9:48 AM Prakhar Mathur wrote: > >> Hi, >> >> We are currently

Job Manager taking long time to upload job graph on remote storage

2020-09-02 Thread Prakhar Mathur
tweaking any configuration? Thank you. Regards Prakhar Mathur

Re: Sending custom statsd tags

2019-10-31 Thread Prakhar Mathur
Hi Chesnay, Thanks for the response, can you point me to some existing example for this? On Wed, Oct 30, 2019 at 5:30 PM Chesnay Schepler wrote: > Not possible, you'll have to extend the StatsDReporter yourself to add > arbitrary tags. > > On 30/10/2019 12:52, Prakhar Mathur w

Sending custom statsd tags

2019-10-30 Thread Prakhar Mathur
Prakhar Mathur

Per Partition Watermarking source idleness

2019-08-23 Thread Prakhar Mathur
Hi, We are using flink v1.6. We are facing data loss issues while consuming data from older offsets in Kafka with windowing. We are exploring per partition watermarking strategy. But we noticed that when we are trying to consume from multiple topics and if any of the partition is not receiving

Re: Job Manager becomes irresponsive if the size of the session cluster grows

2019-07-26 Thread Prakhar Mathur
har, > > Sorry I could not find any abnormal message from your GC log and stack > trace. > Have you ever tried deploying the cluster in other ways? Not on > Kubernetes. Like on YARN or standalone. Just for narrowing down the scope. > > > On Tue, Jul 23, 2019 at 12:34

Re: Job Manager becomes irresponsive if the size of the session cluster grows

2019-07-22 Thread Prakhar Mathur
On Mon, Jul 22, 2019, 16:08 Prakhar Mathur wrote: > Hi, > > We enabled GC logging, here are the logs > > [GC (Allocation Failure) [PSYoungGen: 6482015K->70303K(6776832K)] > 6955827K->544194K(20823552K), 0.0591479 secs] [Times: user=0.09 sys=0.00, > real=0.06 secs

Job Manager becomes irresponsive if the size of the session cluster grows

2019-07-17 Thread Prakhar Mathur
metric for some irregular interval. Even the Jobmanager pod keeps restarting because it stops responding to the liveliness probe which results in Kubernetes killing the pod. We tried increasing the resources given(CPU, RAM) but it didn't help. Regards Prakhar Mathur Product Engineer GO-JEK