Re: GenericType problem in KeyedCoProcessFunction after disableGenericTypes()

the flexibility of Kyro? On Wed, Feb 2, 2022 at 11:22 AM Deniz Koçak wrote: > > Hi Yoel, > > Thank you for answering my question, really appreciated. However, that > brings my mind more questions. > > 1) As far as I understood from the Flink built-in serialization, if a >

Re: GenericType problem in KeyedCoProcessFunction after disableGenericTypes()

> > > On Tue, Feb 1, 2022, 10:01 PM Deniz Koçak wrote: >> >> Hi All, >> >> We have a function extending `KeyedCoProcessFunction` and within that >> function implementation. I wanted to keep a class object as a field >> which is simply respons

GenericType problem in KeyedCoProcessFunction after disableGenericTypes()

Hi All, We have a function extending `KeyedCoProcessFunction` and within that function implementation. I wanted to keep a class object as a field which is simply responsible for generating a UUID. We disabled Kyro fallback for generic types via `env.getConfig().disableGenericTypes()`. I am

Setting egress topic name in stateful functions module definition

Hi, In an Kafka module definition [1], I want to explicitly set the name of the outbound Kafka topic in the egress definition below, but could not find any reference to it in the docs. We are not using Java SDK, which seems to be allowing us to set such details, so not sure how it could be

Re: Stateful functions module configurations (module.yaml) per deployment environment

d > additional flink configurations (flinkConfiguration) property. > > I hope this helps, > Igal. > > [1] https://github.com/igalshilman/flink-statefun/tree/custom_module > [2] > https://docs.ververica.com/user_guide/application_operations/deployments/index.html#deplo

Re: Stateful functions module configurations (module.yaml) per deployment environment

gt; > [1] > https://docs.ververica.com/user_guide/application_operations/deployments/artifacts.html?highlight=additionaldependencies > > On Fri, Dec 3, 2021 at 4:51 PM Deniz Koçak wrote: > > > > Hi Igal, > > > > We are using official images from Ververica as the Flink

Re: Stateful functions module configurations (module.yaml) per deployment environment

ions in different environments. > > I'm not aware of a way to submit any additional files with the jar via the > flink cli, but perhaps someone else can chime in :-) > > Cheers, > Igal. > > > On Thu, Dec 2, 2021 at 3:29 PM Deniz Koçak wrote: >> >> Hi, >&g

Re: Stateful function endpoint self-signed certificate problem

our followup question :-) > > StateFun uses the trust store configured in the JVM, so if you can install > your certificate there, StateFun should transparently pick it up. > > Good luck, > Igal. > > On Fri, Nov 26, 2021 at 10:23 AM Deniz Koçak wrote: >> >>

Stateful functions module configurations (module.yaml) per deployment environment

Hi, We have a simple stateful-function job, consuming from Kafka, calling an HTTP endpoint (on AWS via an Elastic Load Balancer) and publishing the result back via Kafka again. * We created a jar file to be deployed on a standalone cluster (it's not a docker Image), therefore we add

Stateful function endpoint self-signed certificate problem

Hi, We have been running a simple stateful functions (version 3.0.0) job, which simply forwards the incoming messages via Kafka source to an HTTPS endpoint on AWS. Our HTTP endpoint is behind a Load Balancer on AWS and this Load Balancer is listening on 443 for incoming HTTPS traffic. Certificate

NoResourceAvailableException on taskmanager(s)

Hi, We have been running our job on flink image 1.13.2-stream1-scala_2.12-java11. It's a standalone deployment on a Kubernetes cluster (EKS on AWS which uses EC2 nodes as hosts and also depends on a auto-scaler to adjust the resources cluster wide). After a few mins. (5-20) we see the exception

Installing signalfx on flink image

Hi, In order to install SignalFX on Flink it says on Flink Packages page [1] `In order to use this reporter you must copy flink-metrics-signalfx-{{version}}.jar into the /lib folder of your Flink distribution.` We have been using official/original Docker images of Flink distributions supplied by

Calling a stateful fuction from Flink Job - DataStream Integration

Hi, We would like to host a separate service (logically and possibly physically) from the Flink Job which also we would like to call from our Flink Job. We have been considering remote functions via HTTP which seems to be good option on cloud. We have been considering Async I/o and statefun to

Re: Event Time Timers in Process functions when time characteristic is ProcessingTime

, of course. Besides, explicitly using > processing-time windows and timers works in event-time mode. > Please note that In Flink1.12, the default stream time characteristic has > been changed to EventTime [1]. > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.13/rele

Event Time Timers in Process functions when time characteristic is ProcessingTime

Hi, In environment configuration when set the time characteristics to ProcessingTime via setStreamTimeCharacteristic(...) call, I cannot see watermarks in the Flink UI. I think this is expected, because watermarks disabled in the source (using Kafka as source)? Another point here is, can I use