Hi,
We have a simple stateful-function job, consuming from Kafka, calling
an HTTP endpoint (on AWS via an Elastic Load Balancer) and publishing
the result back via Kafka again.
* We created a jar file to be deployed on a standalone cluster (it's
not a docker Image), therefore we add `statefun-fli
Hi Deniz,
StateFun would be looking for module.yaml(s) in the classpath.
If you are submitting the job to an existing Flink cluster this really
means that it needs to be either:
1. packaged with the jar (like you are already doing)
2. be present at the classpath, this means that you can place your
Hi Igal,
We are using official images from Ververica as the Flink installation.
Actually, I was hoping to specify the name of file names to use during
the runtime via `mainArgs` in the deployment configuration (or any
other way may be). By this way we can specify the target yaml files,
but I think
Hi Deniz,
Great to hear from someone using Ververica Platform with StateFun.
When deploying your job you can specify `additionalConfigurations`[1]
that are also pulled and put into the classpath.
Hopefully, that is suitable for your scenario.
Best,
Fabian
[1]
https://docs.ververica.com/user_gu
Hi Fabian,
Thanks for that solution.. I've removed the module.yaml file from the
jar file assuming that it should be fetched from s3 and used by the
job. I've tried this on our job, but still its seems to be failing.
>From the logs module.yaml file seems to be fetched from s3 bucket.
com.ver
Hello Deniz,
Looking at /flink/usrlib and the way it is expected to be used, Flink will
only pick up .jar files and include
them into the classpath, so unfortunately it is being excluded.
If you want it to just make it work and get on with your day, you can
simply place module.yaml in a separate J
Hello Igal,
First of all, thanks for your effort and feedback on that issue.
We followed the steps you specified and it seems to be working, in
order to briefly summarize what we have done (nothing different
actually you specified on your e-mail)
1) Compiled `statefun-flink-distribution` artifact
Hello Deniz,
Glad to hear that it worked for you! as this is a feature that might
benefit others in the community I've just merged this to our main branch,
which means that feature releases will have that feature :-)
Currently there are no plans to backport this to 3.1 however.
Cheers,
Igal.
On
