Re:Changing GC settings of Taskmanager

2024-07-30 Thread Xuyang
Hi, Banu. Could you check whether the "Configuration" icon under the "Task Managers" and "Job Manager" buttons on the left side of the Flink-UI shows that the currently effective flink conf includes these JVM changes? I suspect that you are using a session cluster mode, where changes to the

Elasticsearch 8.x Connector in Maven

2024-07-30 Thread Rion Williams
Hi all, I see that the Elasticsearch Connector for 8.x is supported per the repo (and completed JIRAs). Is there a way to reference this via Maven? Or is it required to build the connector from the source directly? We recently upgraded an Elasticsearch cluster to 8.x and some of the writes are

Re: checkpoint upload thread

2024-07-30 Thread Yanfei Lei
Hi Enric, If I understand correctly, one subtask would use one `asyncOperationsThreadPool`[1,2], it is possible to use the same connection for an operator chain. [1]

KafkaSink self-defined RoundRobinPartitioner not able to discover new partitions

2024-07-30 Thread Lei Wang
I wrote a FlinkRoundRobinPartitioner extends FlinkKafkaPartitioner and use it as following: KafkaSink kafkaSink = KafkaSink.builder() .setBootstrapServers(sinkServers).setKafkaProducerConfig(props) .setDeliverGuarantee(DeliveryGuarantee.AT_LEAST_ONCE)

Re: custom metric reporter

2024-07-30 Thread Dominik.Buenzli
Hi Sigalit Did you add the classpath to the META-INF.services folder of the reporter? [cid:image001.png@01DAE256.1C0ADDF0] The content of my file is: org.apache.flink.metrics.custom.NestedGaugePrometheusReporterFactory Kind regards Dominik From: Sigalit Eliazov Date: Monday, 29 July 2024