Re: Flink-Metrics Prometheus - Native Histograms / Native Counters

2023-06-29 Thread Ryan van Huuksloot
). I lean towards option 4, and we would communicate the change internally as part of a minor version upgrade. I'm open to other ideas and would welcome further discussion on what the OSS community prefers. Thanks, Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopi

Re: Flink-Metrics Prometheus - Native Histograms / Native Counters

2023-06-30 Thread Ryan van Huuksloot
Hi Martijn, Option 2 and 3 would use a single client. It would just register the metrics differently. Does that make sense? Does that change your perspective? Thanks, Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] <https://www.shopify.com/?utm_med

Re: Flink-Metrics Prometheus - Native Histograms / Native Counters

2023-06-30 Thread Ryan van Huuksloot
a new package to keep things distinct. Thanks, Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] <https://www.shopify.com/?utm_medium=salessignatures&utm_source=hs_email> On Fri, Jun 30, 2023 at 10:02 AM Martijn Visser wrote: > Hi Patrick, > > Yeah

Re: Flink-Metrics Prometheus - Native Histograms / Native Counters

2023-06-30 Thread Ryan van Huuksloot
Sounds good - I haven't looked too much into the comparison of the old and new client. Opened a ticket: https://issues.apache.org/jira/browse/FLINK-32508 I may have some time to support this ticket in 2 weeks but anyone can feel free to start working on it. Thanks, Ryan van Huukslo

Flink-Metrics Prometheus - Native Histograms / Native Counters

2023-06-15 Thread Ryan van Huuksloot
that there was a closed PR for the simpleclient: https://github.com/apache/flink/pull/21047 - which has what is required for the native metrics but may cause other maintenance tickets. Is there any appetite from the community to update this exporter? Thanks, Ryan van Huuksloot Sr. Production

Re: [VOTE] FLIP-246: Dynamic Kafka Source (originally Multi Cluster Kafka Source)

2023-06-19 Thread Ryan van Huuksloot
+1 (non-binding) +1 for DynamicKafkaSource Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] <https://www.shopify.com/?utm_medium=salessignatures&utm_source=hs_email> On Mon, Jun 19, 2023 at 8:15 AM Martijn Visser wrote: > +1 (bindin

Re: Flink-Metrics Prometheus - Native Histograms / Native Counters

2023-06-20 Thread Ryan van Huuksloot
Following up, any interest in flink-metrics-prometheus? It is quite a stale package. I would be interested in contributing - time permitting. Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] <https://www.shopify.com/?utm_medium=salessignatures&utm_source=h

RE: Re: [DISCUSS] Contribution of Multi Cluster Kafka Source

2022-06-28 Thread Ryan van Huuksloot
are working with that is public? Could you attach that so we can start looking at it? Let us know if you need anything from us to help move this forward. Thanks! Ryan van Huuksloot Data Developer | Data Platform Engineering | Streaming Capabilities [image: Shopify] <https://www.shopify.

Kubernetes Operator Managed Ingress with TLS

2023-12-08 Thread Ryan van Huuksloot
open source. Happy to move the discussion to Jira. Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] <https://www.shopify.com/?utm_medium=salessignatures&utm_source=hs_email>

Flink Kubernetes Operator Observed Generation

2023-12-12 Thread Ryan van Huuksloot
-implementing-observedgeneration-250728868792 I think we keep the current implementation of the reconciliation spec for now but at the same time, we can update the `status.observedGeneration`? I'll open an issue if folks agree with this addition. Ryan van Huuksloot Sr. Production Eng

Re: [DISCUSS] Kubernetes Operator 1.8.0 release planning

2024-02-07 Thread Ryan van Huuksloot
I can volunteer to be a release manager. I haven't done it for Apache/Flink or the operator before so I may be a good candidate. Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] <https://www.shopify.com/?utm_medium=salessignatures&utm_source=hs_email>

Unable to override PrometheusReporter using PrometheusGateway 'filterLabelValueCharacters'

2024-03-13 Thread Ryan van Huuksloot
x27;ll also open a JIRA ticket as soon as someone validates that it doesn't work as intended. Thanks, Ryan van Huuksloot Sr. Production Engineer | Streaming Platform [image: Shopify] <https://www.shopify.com/?utm_medium=salessignatures&utm_source=hs_email>

RE: [DISCUSS] Contribution of Multi Cluster Kafka Source

2022-09-02 Thread Ryan van Huuksloot
Hi Mason, First off, thanks for putting this FLIP together! Sorry for the delay. Full disclosure Mason and I chatted a little bit at Flink Forward 2022 but I have tried to capture the questions I had for him then. I'll start the conversation with a few questions: 1. The concept of streamIds is n

RE: [DISCUSS] FLIP-246: Multi Cluster Kafka Source

2022-09-04 Thread Ryan van Huuksloot
Hi Mason, First off, thanks for putting this FLIP together! Sorry for the delay. Full disclosure Mason and I chatted a little bit at Flink Forward 2022 but I have tried to capture the questions I had for him then. I'll start the conversation with a few questions: 1. The concept of streamIds is n

Re: [DISCUSS] FLIP-246: Multi Cluster Kafka Source

2022-10-06 Thread Ryan van Huuksloot
icPartition won't work because the topic may be the same name as this is something that is supported IIRC - I chose to pass a map into starting offsets just for demonstrative purposes, I would be fine with whatever data structure would work best Ryan van Huuksloot Data Developer | Productio

[jira] [Created] (FLINK-32508) Flink-Metrics Prometheus - Native Histograms / Native Counters

2023-06-30 Thread Ryan van Huuksloot (Jira)
Ryan van Huuksloot created FLINK-32508: -- Summary: Flink-Metrics Prometheus - Native Histograms / Native Counters Key: FLINK-32508 URL: https://issues.apache.org/jira/browse/FLINK-32508 Project

[jira] [Created] (FLINK-33803) Add observedGeneration to Operator's status spec

2023-12-12 Thread Ryan van Huuksloot (Jira)
Ryan van Huuksloot created FLINK-33803: -- Summary: Add observedGeneration to Operator's status spec Key: FLINK-33803 URL: https://issues.apache.org/jira/browse/FLINK-33803 Project:

[jira] [Created] (FLINK-34991) Flink Operator ClassPath Race Condition Bug

2024-04-02 Thread Ryan van Huuksloot (Jira)
Ryan van Huuksloot created FLINK-34991: -- Summary: Flink Operator ClassPath Race Condition Bug Key: FLINK-34991 URL: https://issues.apache.org/jira/browse/FLINK-34991 Project: Flink