Re: Reply:DelegationTokenManager

2022-06-20 Thread Márton Balassi
Hi, For your information G (ccd) is actively working on this topic. [1] He is in the best position to answer your questions as far as I know. :-) [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-211%3A+Kerberos+delegation+token+framework On Tue, Jun 21, 2022 at 8:38 AM vtygoss wrote:

Reply:DelegationTokenManager

2022-06-20 Thread vtygoss
Hi, flink community! I don't know much details for KDC. Can different TaskManagers hold different tokens? If so, driver and each worker can renew their tokens in their respective DelegationTokenManager individually. Thanks for your any replies. Best Regards! 在 2022年6月21日 13:30,vtygoss

DelegationTokenManager

2022-06-20 Thread vtygoss
Hi, flink community! I am trying to do some work on renewing DelegationToken periodically for DelegtionTokenManager, and met some problems. 1. Implementations of DelegationTokenProvider There seems to be only two implementations for testing defined by SPI service: TestDelegationTokenProv

Re: Flink config driven tool ?

2022-06-20 Thread sri hari kali charan Tummala
found one more flink tool https://www.splunk.com/en_us/products/stream-processing.html On Wed, Jun 15, 2022 at 1:18 PM Jing Ge wrote: > Hi, > > Just like Shengkai mentioned. I would strongly suggest trying SQL for ETL > dag. If you find anything that SQL does not work for you, please share your

Re: New KafkaSource API: Change in default behavior regarding starting offset

2022-06-20 Thread Shengkai Fang
hi. Please use English in the user mail list. If you want to unsubscribe the mail list, you can send mail to user-unsubscr...@flink.apache.org . Best, Shengkai liangzai 于2022年6月19日周日 10:36写道: > 请问这个邮件咋退订? > > > Replied Message > From bastien dine > Date 06/15/2022 17:50 > To Marti

Re: Flink Kubernetes Operator with K8S + Istio + mTLS - port definitions

2022-06-20 Thread Martijn Visser
The Istio guideline implies that this is a guidance, not a standard. Is that correct? Is there a standard (already)? I think we should follow a standard as Flink and avoid implementing guidelines from different vendors/providers. Op ma 20 jun. 2022 om 13:36 schreef Nathan Fisher : > Would it make

Re: Flink Kubernetes Operator with K8S + Istio + mTLS - port definitions

2022-06-20 Thread Nathan Fisher
Would it make sense to add the annotations to the task manager and job manager? In a non-istio environment it’d be a noop. mTLS as a requirement is more complicated but having some docs around using cert-manager might be enough depending on the orgs requirement. On Mon, Jun 20, 2022 at 06:18, Őrh

Re: Flink Kubernetes Operator with K8S + Istio + mTLS - port definitions

2022-06-20 Thread Őrhidi Mátyás
It seems Istio must be configured to allow Akka cluster communication to bypass the Istio sidecar proxy: https://doc.akka.io/docs/akka-management/current/bootstrap/istio.html On Mon, Jun 20, 2022 at 11:30 AM Sigalit Eliazov wrote: > Hi, > we have enabled HA as suggested, the task manager tries t

Re: Flink Kubernetes Operator with K8S + Istio + mTLS - port definitions

2022-06-20 Thread Sigalit Eliazov
Hi, we have enabled HA as suggested, the task manager tries to reach the job manager via pod id as expected but the task manager is unable to connect to the job manager: 2022-06-19 22:14:45,101 INFO org.apache.flink.runtime.taskexecutor.TaskExecutor [] - Connecting to ResourceManager akk