Re: Netty Client Thread - Classloader leak

I suddenly realised that I replied directly to Sudharsan. FYI if anyone wants to check this email too: > On 2 Mar 2022, at 11:36 PM, yu'an huang wrote: > > Hi Sudharsan, > > I think you are right. I just tried your scenario. I set a standalone session > cluster with 2 task managers (with

Re: K8s部署Flink 作业，无法在Web UI查看TaskManger的STDOUT日志

可以通过降低restratstrategy的统计灵敏度，短时间持续出现同个异常导致的failed只会计数一次，目前已经有相关patch，具体可看： https://issues.apache.org/jira/browse/FLINK-26315 > 2022年3月2日 下午4:35，Yang Wang > 写道： > > Standalone Flink on K8s 和 native K8s都会有你说的这个问题 >

Flink On K8s ???????? SSL????????

K8sk8s~/.kube/config.SSL??kubectl??k8s (kubectl get pod -n namespace ??)?? Flink: 1.13.6 ~/.kube/config apiVersion:v1 kind:config cluster: -name: "yf-dev-cluster1" cluster: server:

Customizing backpressure mechanism for RichParallelSourceFunction

Hello! I have a dataflow pipeline built using Flink's RichParallelSourceFunction as parallel sources. I'm wondering if there are any mechanisms that I could use to implement *ack-based* back-pressure mechanism by sending ACK messages from operators (within the runtime) to source functions to

Re:回复: Flink FailureRateRestartStrategy策略异常

可以通过降低restratstrategy的统计灵敏度，短时间持续出现同个异常导致的failed只会计数一次，目前已经有相关patch，具体可看： https://issues.apache.org/jira/browse/FLINK-26315 在 2022-03-02 12:04:39，"刘 家锹" 写道： >你好，感谢回答我的疑问 > >我想我大概找到原因了，跟你说的一样。使用pipelined-region的failover策略，而作业本身切分了6个reion，在一次container失败当中就会全部失败。

退订

退订

Re: KafkaPartitionSplitReader handleSplitsChanges

Or is the motivation that resolving the committed/latest offsets is an infrequent event (and only for bounded read) so the optimization is not worth it? On Wed, Mar 2, 2022 at 2:16 PM Mason Chen wrote: > Hi all, > > I noticed in the javadocs that SplitReaders should not have a blocking >

Questions regarding connecting local FlinkSQL client to remote JobManager in K8s

Hi Flink users, Wanted to check if any of you tried to run the local FlinkSQL client against JobManager running in the Kubernetes environment. For local FlinkSQL Client and local Flink cluster we set these params: jobmanager.rpc.address: localhost jobmanager.rpc.port: 6123 To make it work, Is

KafkaPartitionSplitReader handleSplitsChanges

Hi all, I noticed in the javadocs that SplitReaders should not have a blocking handleSplitsChanges implementation: https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-base/src/main/java/org/apache/flink/connector/base/source/reader/splitreader/SplitReader.java#L55

Help with pom dependencies for Flink with Table API

Hello, I think I accidentally posted this question on the wrong email list (dev) so I am posting it again here. I am struggling to run my test Flink project with Table API I am trying to run a simple piece of code: final StreamExecutionEnvironment env =

Re: Flink failure rate restart not work as expect

Hi, Jiaqiao: Since your job enables checkpoint, you can just try to remove the restart strategy config. The default value will be fixed-delay with Integer.MAX_VALUE restart attempts and '1 s' delay, as mentioned in [1]. In this way when a failover occurs, your job will wait for 1 seconds before

Re: Flink 1.13.6 showing 1.13.5

Hi Razin, Would you mind sharing the Kubernetes manifest you're using to deploy this? Or which docker tag you are using? I spun up a quick example using the docker tag 'flink:1.13.6' and the correct version was shown in the JobManager logs and in the web-ui. Kind regards, Mika On 01.03.2022

Re: 使用CUMULATE WINDOW 消费upsertkafka遇到的问题

Hi！ window tvf 目前不支持消费 changelog，也就是说只能消费 insert 数据。upsert-kafka source 是一个会产生 changelog 的 source，因此下游不能接 window tvf。 赵旭晨 于2022年3月1日周二 15:23写道： > sql如下： > with effective_chargeorder as ( > select > o.recordcreatedtime,o.recordcreateduser,o.status,o._is_delete,o.appointmentid, >

Kafka Source in a Geo Replicated Kafka Cluster

Hi, I need to manage geo-redundancy in my Kafka cluster across zones. I am planning to do this with Apache Mirror Maker to maintain an active-passive site. I wanted to understand consumer and producer failover when the primary cluster fails. Is there any way to detect and failover Flink's Kafka

Left join query not clearing state after migrating from 1.9.0 to 1.14.3

Hello, We recently did a migration of our Flink jobs from version 1.9.0 to 1.14.3. These jobs consume from Kafka and produce to respective sinks. We are using MemoryStateBackend for our checkpointing and GCS as our remote fs. After migration, we found a few jobs that had left join in the SQL

Re: K8s部署Flink 作业，无法在Web UI查看TaskManger的STDOUT日志

Standalone Flink on K8s 和 native K8s都会有你说的这个问题 主要原因是标准输出打印到的pod console了，所以通过kubectl logs可以查看stdout日志，但webUI上就没有 你可以参考这个commit[1]自己编译一个Flink binary来实现 [1]. https://github.com/wangyang0918/flink/commit/2454b6daa2978f9ea9669435f92a9f2e78de357a Best, Yang xinzhuxiansheng 于2022年3月2日周三 15:00写道：

Re: Flink job recovery after task manager failure

Thanks. At the moment I’m running without a shared file storage, and I’m trying to better understand the recovery process. The behavior I see is as follows: * The job manager identifies the task manager’s failure and tries to restart * The job manager fails to find the checkpoint.