Re: Native Kubernetes Task Managers

2024-06-09 Thread Alexis Sarda-Espinosa
ibes the pod index. > > > > Regards, > Zhuo. > ---- Replied Message ---- > | From | Alexis Sarda-Espinosa | > | Date | 06/3/2024 14:19 | > | To | | > | Subject | Re: Native Kubernetes Task Managers | > Ah no, I meant that I wouldn't use a stateful set, rather j

Re: Native Kubernetes Task Managers

2024-06-03 Thread Alexis Sarda-Espinosa
you mean by the naming scheme. I think the > limitation "pods in a StatefulSet are always terminated in the reverse > order as they are created" comes from Kubernetes and has nothing to do with > the naming scheme. > > Best, > > Xintong > > > > On Mon, Jun 3, 2

Re: Native Kubernetes Task Managers

2024-06-02 Thread Alexis Sarda-Espinosa
er, since the > diagnostics are from K8s, I'm not 100% sure whether this behavior is same > for all K8s versions,. > > Best, > > Xintong > > > > On Sun, Jun 2, 2024 at 7:35 PM Alexis Sarda-Espinosa < > sarda.espin...@gmail.com> wrote: > > > Hi devs, &

Native Kubernetes Task Managers

2024-06-02 Thread Alexis Sarda-Espinosa
Hi devs, Some time ago I asked about the way Task Manager pods are handled by the native Kubernetes driver [1]. I have now looked a bit through the source code and I think it could be possible to deploy TMs with a stateful set, which could allow tracking OOM kills as I mentioned in my original

[jira] [Created] (FLINK-34400) Kafka sources with watermark alignment sporadically stop consuming

2024-02-06 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-34400: - Summary: Kafka sources with watermark alignment sporadically stop consuming Key: FLINK-34400 URL: https://issues.apache.org/jira/browse/FLINK-34400

[jira] [Created] (FLINK-34325) Inconsistent state with data loss after OutOfMemoryError in Job Manager

2024-01-31 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-34325: - Summary: Inconsistent state with data loss after OutOfMemoryError in Job Manager Key: FLINK-34325 URL: https://issues.apache.org/jira/browse/FLINK-34325

[jira] [Created] (FLINK-30638) Operator doesn't forward allowNonRestoredState flag

2023-01-11 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-30638: - Summary: Operator doesn't forward allowNonRestoredState flag Key: FLINK-30638 URL: https://issues.apache.org/jira/browse/FLINK-30638 Project: Flink

[jira] [Created] (FLINK-30306) Audit utils can expose potentially sensitive information

2022-12-05 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-30306: - Summary: Audit utils can expose potentially sensitive information Key: FLINK-30306 URL: https://issues.apache.org/jira/browse/FLINK-30306 Project

[jira] [Created] (FLINK-30305) Operator deletes HA metadata during stateful upgrade, preventing potential manual rollback

2022-12-05 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-30305: - Summary: Operator deletes HA metadata during stateful upgrade, preventing potential manual rollback Key: FLINK-30305 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-30115) Include log4j-layout-template-json jar in the default operator image

2022-11-21 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-30115: - Summary: Include log4j-layout-template-json jar in the default operator image Key: FLINK-30115 URL: https://issues.apache.org/jira/browse/FLINK-30115

[jira] [Created] (FLINK-29716) Separate slf4j jar in the lib folder from the distribution

2022-10-21 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-29716: - Summary: Separate slf4j jar in the lib folder from the distribution Key: FLINK-29716 URL: https://issues.apache.org/jira/browse/FLINK-29716 Project

[jira] [Created] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

2022-05-05 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-27504: - Summary: State compaction not happening with sliding window and incremental RocksDB backend Key: FLINK-27504 URL: https://issues.apache.org/jira/browse/FLINK

RE: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-07 Thread Alexis Sarda-Espinosa
leased after the operator version that is being used, he/she > > > would > need > > > to upgrade the operator version first? > > > I'm not questioning this, just trying to make sure I'm > > > understanding > this > > > correctly. > > > &

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-05 Thread Alexis Sarda-Espinosa
Hi everyone, just wanted to mention that my employer agreed to open source the PoC I developed: https://github.com/MicroFocus/opsb-flink-k8s-operator I understand the concern for maintainability, so Gradle & Kotlin might not be appealing to you, but at least it gives you another reference. The

Re: Flink native k8s integration vs. operator

2022-01-21 Thread Alexis Sarda-Espinosa
mean an operator is a bad idea, it's just something that other users might want to keep in mind. Regards, Alexis. From: Robert Metzger Sent: Thursday, January 20, 2022 7:06 PM To: Alexis Sarda-Espinosa Cc: dev ; user Subject: Re: Flink native k8s integration vs

RE: Flink native k8s integration vs. operator

2022-01-18 Thread Alexis Sarda-Espinosa
Hi everyone, Since I see this is getting some traction, I’d like to add a couple things. I had been developing a Kubernetes controller for Flink as a Proof of Concept at my company; I called it Flork because it was to be a Flink Orchestrator for Kubernetes. In the end, we will most likely not

[jira] [Created] (FLINK-21763) Extend Data Stream's batch mode to handle partitioning/grouping/ordering

2021-03-13 Thread Alexis Sarda-Espinosa (Jira)
Alexis Sarda-Espinosa created FLINK-21763: - Summary: Extend Data Stream's batch mode to handle partitioning/grouping/ordering Key: FLINK-21763 URL: https://issues.apache.org/jira/browse/FLINK-21763

[jira] [Created] (FLINK-10489) Inconsistent window information for streams with EventTime characteristic

2018-10-04 Thread Alexis Sarda-Espinosa (JIRA)
Alexis Sarda-Espinosa created FLINK-10489: - Summary: Inconsistent window information for streams with EventTime characteristic Key: FLINK-10489 URL: https://issues.apache.org/jira/browse/FLINK-10489

[jira] [Created] (FLINK-10408) Cannot use window information in Table functions

2018-09-24 Thread Alexis Sarda-Espinosa (JIRA)
Alexis Sarda-Espinosa created FLINK-10408: - Summary: Cannot use window information in Table functions Key: FLINK-10408 URL: https://issues.apache.org/jira/browse/FLINK-10408 Project: Flink

[jira] [Created] (FLINK-10194) Serialization issue with Scala's AggregateDataSet[Row]

2018-08-21 Thread Alexis Sarda-Espinosa (JIRA)
Alexis Sarda-Espinosa created FLINK-10194: - Summary: Serialization issue with Scala's AggregateDataSet[Row] Key: FLINK-10194 URL: https://issues.apache.org/jira/browse/FLINK-10194 Project

[jira] [Created] (FLINK-10126) There should be a Scala DataSource

2018-08-12 Thread Alexis Sarda-Espinosa (JIRA)
Alexis Sarda-Espinosa created FLINK-10126: - Summary: There should be a Scala DataSource Key: FLINK-10126 URL: https://issues.apache.org/jira/browse/FLINK-10126 Project: Flink Issue