Thank you both! I'll try to switch the scheduler to "AdaptiveBatchScheduler".
Best,
Irakli
From: Junrui Lee
Sent: 05 March 2024 03:50
To: user
Subject: Re: Batch mode execution
Hello Irakli,
The error is due to the fact that the Adaptive Scheduler doesn’t suppo
Hi Gabriele,
Quick answer: You can use the built-in window operators which have been
integrated with state backends including RocksDB.
Thanks,
Zakelly
On Tue, Mar 5, 2024 at 10:33 AM Zhanghao Chen
wrote:
> Hi Gabriele,
>
> I'd recommend extending the existing window function whenever possible
Hello Irakli,
The error is due to the fact that the Adaptive Scheduler doesn’t support
batch jobs, as detailed in the Flink documentation[1]. When operating in
reactive mode, Flink automatically decides the type of scheduler to use.
For batch execution, the default scheduler is AdaptiveBatchSchedu
Hi Gabriele,
I'd recommend extending the existing window function whenever possible, as
Flink will automatically cover state management for you and no need to be
concerned with state backend details. Incremental aggregation for reduce state
size is also out of the box if your usage can be satis
Hello Irakli and thank you for your question.
I guess that somehow Flink enters the "reactive" mode while the adaptive
scheduler is not configured.
I would go with 2 options to isolate your issue:
• Try with forcing the scheduling mode
(https://nightlies.apache.org/flink/flink-docs-release-1.1
Hello,
I have a Flink job which is processing bounded number of events. Initially, I
was running the job in the "STREAMING" mode, but I realized that running it in
the "BATCH" mode was better as I don't have to deal with the Watermark
Strategy. The job is reading the data from the Kafka topic a
It should be compatible. There is no compatibility matrix but it is
compatible with most versions that are in use (at the different
companies/users etc)
Gyula
On Thu, Feb 29, 2024 at 6:21 AM 吴圣运 wrote:
> Hi,
>
> I'm using flink-operator-1.5.0 and I need to deploy it to Kubernetes 1.20.
> I want
Dear Flink Community,
I am using Flink with the DataStream API and operators implemented using
RichedFunctions. I know that Flink provides a set of window-based
operators with time-based semantics and tumbling/sliding windows.
By reading the Flink documentation, I understand that there is the
Hi Arjun,
I have raised a Jira for this case and attached a patch:
https://issues.apache.org/jira/browse/FLINK-34565
-Surendra
On Wed, Feb 21, 2024 at 12:48 AM Surendra Singh Lilhore <
surendralilh...@apache.org> wrote:
> Hi Arjun,
>
> Yes, direct support for external configuration files withi
