Re: How to reduce interval between Uptime Metric meaasurements?

2021-12-31 Thread Geldenhuys, Morgan Karl
Thanks for the hint, however i am not using the prometheus push gateway. Regards, M. From: Caizhi Weng Sent: 28 December 2021 02:17:34 To: Geldenhuys, Morgan Karl Cc: user@flink.apache.org Subject: Re: How to reduce interval between Uptime Metric meaasurements?

Re: Mapstate got wrong UK when restored.

2021-12-31 Thread Joshua Fan
HI David Thanks a lot. I almost get the point. When I use initializeState to restore the mapstate, the task can not get a key at that moment, so I just get the key but not the UK, when I use the mapstate in processElement, a key will be provided implictly, so I would get the right UK and UV. But s

Flink Kinesis Producer con't connect with AWS credentials

2021-12-31 Thread Daniel Vol
Hi, I am trying to run a Flink on GCP with the current source and destination on Kinesis on AWS. I have configured the access key on AWS to be able to connect. I am running Flink 1.12.1 In flink I use the following code (Scala 2.12.2) val props = new Properties props.put(AWSConfigConstants.AWS_A

Re: Uploading jar on multiple flink job managers

2021-12-31 Thread Timo Walther
Hi Puneet, are we talking about the `web.upload.dir` [1] ? Maybe others have a better solution for your problem, but have you thought about configuring an NFS or some other distributed file system as the JAR directory? In this case it should be available to all JobManagers. Regards, Timo [1

Re: TypeInformation | Flink

2021-12-31 Thread Timo Walther
Hi Siddhesh, how to use a ProcessFunction is documented here: https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/operators/process_function/ .process() is similar to .map() but with more Flink specific methods available. Anyway, a simple map() should also do the job. But

Re: flink-table-api-scala-bridge missing source files

2021-12-31 Thread Timo Walther
Hi Yuval, feel free to open an issue for this. Looks like a bug in our release artifacts. We should definitely investigate how to solve this as the ScalaDocs are crucial for the development experience. Regards, Timo On 27.12.21 03:22, Zhipeng Zhang wrote: Hi Yuval, It seems that scala cod