Flink窗口状态清除疑问

相关配置： Flink:1.16 | Checkpointing Mode | Exactly Once | | Checkpoint Storage | FileSystemCheckpointStorage | | State Backend | EmbeddedRocksDBStateBackend | | Interval | 8m 0s | 我有一个程序，主要是用来统计一些热门商品之类的数据 具体代码如下： .keyBy(data -> data.getShopId() + data.getYh_productid())

Parallelism under reactive scaling with slot sharing groups

Hello, Our job has operators of source -> sink -> global committer. We have created two slot sharing groups, one for source and sink and one for global committer. The global committer has specified max parallelism of 1. No max parallelism set with the source/sink while there is a system level

About[jobmanager.memory.off-heap.size] not work on Flink(flink-session on yarn)

When I use ESSink, I find that I need to set Flink’s jobmanager.memory.off-heap.size to 256MB. The default 128MB does not meet the running requirements. It can be successful by modifying the configuration file, but I want to dynamically adjust the jobmanager.memory.off-heap.size through the

Re: kafka sink

Hi 1. we use flink 1.17.1 2. there is no traffic and data in the topics when it's happened 3 log part with the error: 2023-07-24 08:41:30,334 DEBUG org.apache.flink.connector.kafka.sink. FlinkKafkaInternalProducer [] - commitTransaction telephony-decoder- ORCHESTRATOR-MULTIMEDIA-IN-8-10

RE: 安装operator

Hi, Jiacheng: helm也是把values.yaml和你在命令行中传入的参数，代入到一些k8s的yaml模版里，render出来一个yaml文件，然后提交到k8s的。 这些是flink kubernetes operator的helm的模版。 https://github.com/apache/flink-kubernetes-operator/tree/main/helm/flink-kubernetes-operator/templates 你完全可以自己人肉修改这些yaml模版，然后提交到k8s，当然这很麻烦，也很容易出错。

Re: Check points are discarded with reason NULL

Hi, This exception is thrown because the number of checkpoint exceptions exceeds execution.checkpointing.tolerable-failed-checkpoints, see [1] for more details. There should be other root causes about the checkpoint exception in your JM/TM logs. You could check or share these. [1]