Hello Sachin,
Typically, Cloud VMs are ephemeral, meaning that if the EMR cluster goes
down or VMs are required to be shut down for security updates or due to
faults, new VMs will be added to the cluster. As a result, any data stored
in the local file system, such as file://tmp, would be lost. To
Hi,
We are using AWS EMR where we can submit our flink jobs to a long running
flink cluster on Yarn.
We wanted to configure RocksDBStateBackend as our state backend to store
our checkpoints.
So we have configured following properties in our flink-conf.yaml
- state.backend.type: rocksdb
- s
Hi Xuyang
I am new to Flink & I don't know how to implement this dependency into the
code.
Can you please share some examples so that I can refer those.
Thanks
Nida
On Fri, Mar 22, 2024 at 7:02 AM Xuyang wrote:
> Hi, Nida.
> Can you explain more details about "unable to use it." ? Did you get
Hi, Nida.
Can you explain more details about "unable to use it." ? Did you get an
exception after using it?
--
Best！
Xuyang
在 2024-03-21 21:14:53，"Fidea Lidea" 写道：
Thank you Xuyang.
I added the above flink-connector-elasticsearch dependency in my project.
But I am unable to use
Hi Jacob,
Flink jobs, tasks typically run on multiple nodes/servers. This means that
it is not possible to have a connection shared on job level.
You can read about the architecture in more detail in the docs. [1]
I hope this helps,
Péter
[1] -
https://nightlies.apache.org/flink/flink-docs-rele
Thank you Xuyang.
I added the above flink-connector-elasticsearch dependency in my project.
But I am unable to use it.
Can you please share a few sample codes which are using this dependency?
Thanks
Nida
On Tue, Mar 12, 2024 at 5:37 PM Xuyang wrote:
> Hi, Fidea.
> Currently, elasticsearch is no
Hello,
Is there a way in Flink to instantiate or open connections (to cache/db) at
global level, so that it can be reused across many process functions rather
than doing it in each operator's open()?Along with opening, also wanted to
know if there is a way to close them at job level stop, such tha
Ok, I see.
Hang Ruan 于2024年3月20日周三 16:08写道：
> Hi, 3pang zhu.
>
> This `Scan Newly added tables` feature requires restarting the job from
> the savepoint. We cannot add new tables to the running job without
> restarting by now.
>
> Best,
> Hang
>
> 3pang zhu 于2024年3月20日周三 15:22写道：
>
>> this link
Congrattulations! Thanks for the great work!
Best,
Zhongqiang Gong
Leonard Xu 于2024年3月20日周三 21:36写道：
> Hi devs and users,
>
> We are thrilled to announce that the donation of Flink CDC as a
> sub-project of Apache Flink has completed. We invite you to explore the new
> resources available:
>
>
