I've noticed that completed job details (single completed job) are being
removed from the Flink web UI after a few hours. I haven't configured an
archive directory or history server. Could you please explain how Flink
clears these job details and after what timeframe? I couldn't find
information on
more
>> information?[1]
>>
>> [1]
>> https://nightlies.apache.org/flink/flink-docs-master/docs/ops/debugging/flame_graphs/
>>
>>
>> --
>> Best！
>> Xuyang
>>
>>
>> At 2024-03-30 18:07:23, "Kartik Kushwaha"
>&g
Hello,
I have a Streaming event processing job that looks like this.
*Source - ProcessFn(3 in total) - Sink*
I am seeing a delay of 50ms to 250ms between each operators (maybe
buffering or serde delays) leading to a slow end- to-end processing. What
could be the reason for such high latency?
So
c.
>
> Best regards,
>
> Martijn
>
> On Mon, Feb 12, 2024 at 4:02 PM Kartik Kushwaha
> wrote:
> >
> > Let me put the question in other words.
> >
> > What happens if a source does not support two phase commit and the Flink
> job has to guarantee ex
source code they haven't been touched for
> the last 7 years [1] and I'm actually not aware of anyone who uses
> Solace at all.
>
> Best regards,
>
> Martijn
>
> [1]
> https://github.com/SolaceLabs/solace-integration-guides/tree/master/src/flink-jms-connector
>
&
Any help here please.
Regards,
Kartik
On Fri, Feb 9, 2024, 8:33 AM Kartik Kushwaha
wrote:
> I am using flink checkpointing to restore states of my job. I am using
> unaligned checkpointing with 100 ms as the checkpointing interval. I see
> few events getting dropped that were su
I am using flink checkpointing to restore states of my job. I am using
unaligned checkpointing with 100 ms as the checkpointing interval. I see
few events getting dropped that were sucessfully processed by the operators
or were in-flight that were yet to be captured by checkpoint. That is these
wer
