Re: Interaction between idling sources and watermark alignment

Thank you very much for the explanation, Hong. On Thu, 15 Jun 2023, 15:55 Teoh, Hong, wrote: > Hi Alexis, below is my understanding: > > > > I see that, in Flink 1.17.1, watermark alignment will be supported (as > beta) within a single source's splits and across different sources. I don't > see

Re: Flink bulk and record file source format metrices

Hi Kamal, In a similar situation, when a decoding failure happened I would generate a special record that I could then detect/filter out (and increment a counter) in a FilterFunction immediately following the source. — Ken > On Jun 16, 2023, at 2:11 AM, Kamal Mittal via user > wrote: > >

Flink Kafka source getting marked as Idle

Hello All, Sorry to be replying to an existing thread for my question. Actually we are also facing the issue of the Flink Kafka source stopping consuming messages completely. It only started consuming messages after we re-submitted the Job. But this happened only once and now it is not

Default Log4j properties in Native Kubernetes

Hi all! Is it possible to change Flink* log4j-console.properties* in Native Kubernetes (for example in Kubernetes Application mode) without rebuilding the application docker image? I was trying to inject a .sh script call (in the attachment) before /docker-entrypoint.sh, but this workaround did

回复：CEP获取不满足模式事件

超时输出可以输出这种不满足条件的，但是必须是超时后才能输出 回复的原邮件 | 发件人 | jiaot...@mail.jj.cn | | 发送日期 | 2023年06月16日 18:04 | | 收件人 | user-zh | | 主题 | CEP获取不满足模式事件 | hello 当我在Flink中定义了一个Patten 例如（a -> b -> c -> d）四个事件，可以很轻松的获取到满足该模式的所有事件，但是当我想获取该模式的子集缺很复杂（在不重新定义的情况下）， 例如我想知道满足（a -> b -> c）模式 、（a ->

RE: Flink bulk and record file source format metrices

Hello, Any way-forward, please suggest. Rgds, Kamal From: Kamal Mittal via user Sent: 15 June 2023 10:39 AM To: Shammon FY Cc: user@flink.apache.org Subject: RE: Flink bulk and record file source format metrices Hello, I need one counter matric for no. of corrupt records while decoding

TAC Applications for Community Over Code North America and Asia now open

Hi All, (This email goes out to all our user and dev project mailing lists, so you may receive this email more than once.) The Travel Assistance Committee has opened up applications to help get people to the following events: *Community Over Code Asia 2023 - * *August 18th to August 20th in

Re: Watermark idleness and alignment - are they exclusive?

That looks exactly like what we hit, thank you! On Thu, Jun 15, 2023 at 10:57 PM Ken Krugler wrote: > I think you’re hitting this issue: > > https://issues.apache.org/jira/browse/FLINK-31632 > > Fixed in 1.16.2, 1.171. > > — Ken > > > On Jun 15, 2023, at 1:39 PM, Piotr Domagalski > wrote: > >

Re: Async IO operator to write to DB

Thanks Hong for sharing this - very helpful. ~ Karthik On Thu, Jun 15, 2023 at 2:55 AM Teoh, Hong wrote: > Hi Karthik, > > As an additional update, since Flink 1.15 we have introduced the > asynchronous sink base, which allows easy writing of an asynchronous sink > (you simply provide the