I'm trying to setup a flink cluster on k8s for production use.But the setup
here
https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/deployment/kubernetes.html this
not ha , when job-manager down and rescheduled
the metadata for running job is lost.
I tried to use ha setup for
Hi Rock,
I searched by Google and found a blog[1] talk about how to config JM HA for
Flink on k8s. Do not know whether it suitable for you or not. Please feel
free to refer to it.
Best,
Vino
[1]:
http://shzhangji.com/blog/2019/08/24/deploy-flink-job-cluster-on-kubernetes/
Rock 于2019年11月16日周六 上
Hi Rock,
If you want to start a ha flink cluster on k8s, the simplest way is to use
ZK+HDFS/S3,
just as the ha configuration on Yarn. The zookeeper-operator could help the
start a zk
cluster.[1] Please share more information that why it could not work.
If you are using kubernetes per-job cluster,
Hi Yang Wang,
Thanks for your reply, I MAY HAVE setup a ha cluster succefully. The reason I
can't setup before may be some bug about s3 in flink, after change to hdfs,I
can run it suceefully.
But after about one day of running ,the job-manager will crash and can't
recover automatic, I must a
d log to my elasticsearch cluster,may the log can tell more..
>
> -- 原始邮件 --
> *发件人:* "Yang Wang";
> *发送时间:* 2019年11月19日(星期二) 中午12:05
> *收件人:* "vino yang";
> *抄送:* "Rock";"user@flink.apache.org"<
> user@flink.apach
