thanks for everyone. I will increase the parallelism to solve the
problem.Besides, I am looking forward to support remote state.
Best,
Hjw
-- --
??:
single container is limited in our company.Are there
>> any idea to deal with this ?
>>
>> --
>> Best,
>> Hjw
>>
>>
>>
>> -- 原始邮件 --
>> *发件人:* "Alexander Fedulov" ;
>>
dulov" ;
> *发送时间:* 2022年9月6日(星期二) 凌晨3:19
> *收件人:* "hjw"<1010445...@qq.com>;
> *抄送:* "user";
> *主题:* Re: Where will the state be stored in the taskmanager when using
> rocksdbstatebend？
>
>
> https://nightlies.apache.org/flink/flink-docs-release-1
Hi,Alexander
When Flink job deployed on Native k8s, taskmanager is a Pod.The data directory
size of a single container is limited in our company.Are there any idea to deal
with this ?
Best,
Hjw
-- --
??:
https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/config/#state-backend-rocksdb-localdir
Make sure to use a local SSD disk (not NFS/EBS).
Best,
Alexander Fedulov
On Mon, Sep 5, 2022 at 7:24 PM hjw <1010445...@qq.com> wrote:
> The EmbeddedRocksDBStateBackend holds in-flig
The EmbeddedRocksDBStateBackend holds in-flight data in
a RocksDB database that is (per default) stored in the TaskManager
local data directories.
Which path does local data directories store RocksDB database in
TaskManager point to in operating system?
If the job state is very large, I think I
