Flink Operator in Golang?

Hi, I found we already have Flink operator implemented by java. But I have two questions: 1. If we can implement Flink operator using golang? Is there some hidden difficult traps? 2. We can submit Java jar jobs or sql jobs, can we submit golang jobs? Thank you.

Re: Kafka transactions drastically limit usability of Flink savepoints

Hi Yordan, Indeed it looks like a missing feature. Probably someone implementing the new KafkaSink didn't realize how important this is. I've created a ticket to work on this issue [1], but I don't know when or who could fix it. I think a workaround might be to create a new `KafkaSink` instance t

Re: Flink Operator in Golang?

Hi Mark, 1. Directly quoting from https://cwiki.apache.org/confluence/display/FLINK/FLIP-212%3A+Introduce+Flink+Kubernetes+Operator: Main reasons for choosing Java over Go * Direct access to Flink Client libraries for submitting, managing jobs and handling errors * Most Flink devel

Re: Kubernetes operator and jobs with last-state upgrades

Hi, When you use last state upgrade, you simply delete the Flink deployment but keeping HA metadata where checkpoint info is stored, and the upgraded job would recover the state from the latest checkpoint. Best, Zhanghao Chen From: Alexis Sarda-Espinosa Sent: T

Increasing the Parallelism for an operation breaks the state due to MaxParallelism

* Flink version 1.15.1 * Running on HA Kubernetes cluster using flink-kubernetes-operator-1.1.0 operator * Using RocksDB Hello everyone, I have a WindowedStream which I apply an aggregate function on SingleOutputStreamOperator> count = windowed.aggregate( new CountAggregateFuncti

Stand alone K8s HA mode with Static Tokens Used by Service Accounts

Hi, Our team has been using flink 1.15 and we have a stand alone K8s flink setup that uses K8s HA services for its HA mode. Recently, our organization is in the works of updating their EKS clusters' Kubernetes versions to 1.21 or later. We received a request from our support team that the service

答复: Flink Operator in Golang?

I got it, Thanks Zhanghao! 发件人: user-return-51640-lifuqiong00=126@flink.apache.org 代表 zhanghao.c...@outlook.com 发送时间: 2022年11月17日 23:36 收件人: Mark Lee ; user@flink.apache.org 主题: Re: Flink Operator in Golang? Hi Mark, 1. Directly quoting from https://cwiki.apache.org/confluence

Re: Flink Operator in Golang?

Golang doesn't seem to have anything similar to Flink or Spark. On Thu, Nov 17, 2022 at 8:11 PM Mark Lee wrote: > I got it, Thanks Zhanghao! > > > > *发件人:* user-return-51640-lifuqiong00=126@flink.apache.org > *代表 * > zhanghao.c...@outlook.com > *发送时间:* 2022年11月17日 23:36 > *收件人:* Mark Lee ;

Deploy Flink Operator in an k8s enviroment without helm?

Hi all, I am trying to deploy flink operator followed Quick Start . But it seems need helm client installed in Kubernetes environment. Could we deploy flink operator without

Re: Deploy Flink Operator in an k8s enviroment without helm?

Hi Mark, I believe you can do that without helm. Just like that you can install some software in CentOS without yum. But you may have to handle some basic setup by yourself. For the operator, you at least have to prepare RBAC creation, serviceAccount creation, Deployment creation or Webhook crea

Re: Deploy Flink Operator in an k8s enviroment without helm?

Adding to what Biao Geng said, yes it is completely possible and other installation methods are used by many users already. You can check the Helm templates in the repo to get an idea what resources you need to create. Actually if you run `helm template flink-kubernetes-operator helm/flink-kuberne

答复: Deploy Flink Operator in an k8s enviroment without helm?

Thanks Biao, Sorry I’m a rookie in helm or operator. I know that I can prepare RBAC, ServiceAccount or Deployment creation by CRs or yaml files. But the basic OS(Kubernetes) environment I can’t install any other software the basic like helm But I can’t install any software(like helm) the basic

答复: Deploy Flink Operator in an k8s enviroment without helm?

Thanks Gyula, My basic OS does not have a helm client and don’t allow install it. Could I deploy flink operator in such situation? 发件人: user-return-51648-lifuqiong00=126@flink.apache.org 代表 Gyula Fóra 发送时间: 2022年11月18日 13:26 收件人: Biao Geng 抄送: Mark Lee ; user@flink.apache.org 主题:

Re: Deploy Flink Operator in an k8s enviroment without helm?

Yes, but as we said you need to install all required resources manually in that case. Gyula On Fri, Nov 18, 2022 at 6:59 AM Mark Lee wrote: > Thanks Gyula, > > My basic OS does not have a helm client and don’t allow install it. > Could I deploy flink operator in such situation? > > > > *发件