Re: Interaction between idling sources and watermark alignment

Thank you very much for the explanation, Hong. On Thu, 15 Jun 2023, 15:55 Teoh, Hong, wrote: > Hi Alexis, below is my understanding: > > > > I see that, in Flink 1.17.1, watermark alignment will be supported (as > beta) within a single source's splits and across different sources. I don't > see

Re: Flink bulk and record file source format metrices

Hi Kamal, In a similar situation, when a decoding failure happened I would generate a special record that I could then detect/filter out (and increment a counter) in a FilterFunction immediately following the source. — Ken > On Jun 16, 2023, at 2:11 AM, Kamal Mittal via user > wrote: > > H

Flink Kafka source getting marked as Idle

Hello All, Sorry to be replying to an existing thread for my question. Actually we are also facing the issue of the Flink Kafka source stopping consuming messages completely. It only started consuming messages after we re-submitted the Job. But this happened only once and now it is not getting

Default Log4j properties in Native Kubernetes

Hi all! Is it possible to change Flink* log4j-console.properties* in Native Kubernetes (for example in Kubernetes Application mode) without rebuilding the application docker image? I was trying to inject a .sh script call (in the attachment) before /docker-entrypoint.sh, but this workaround did n

RE: Flink bulk and record file source format metrices

Hello, Any way-forward, please suggest. Rgds, Kamal From: Kamal Mittal via user Sent: 15 June 2023 10:39 AM To: Shammon FY Cc: user@flink.apache.org Subject: RE: Flink bulk and record file source format metrices Hello, I need one counter matric for no. of corrupt records while decoding parqu

TAC Applications for Community Over Code North America and Asia now open

Hi All, (This email goes out to all our user and dev project mailing lists, so you may receive this email more than once.) The Travel Assistance Committee has opened up applications to help get people to the following events: *Community Over Code Asia 2023 - * *August 18th to August 20th in Bei

Re: Watermark idleness and alignment - are they exclusive?

That looks exactly like what we hit, thank you! On Thu, Jun 15, 2023 at 10:57 PM Ken Krugler wrote: > I think you’re hitting this issue: > > https://issues.apache.org/jira/browse/FLINK-31632 > > Fixed in 1.16.2, 1.171. > > — Ken > > > On Jun 15, 2023, at 1:39 PM, Piotr Domagalski > wrote: > > H