Hello,
I was trying to scale job up, took save point, changed parallelism setting from
6 to 8 and started job from savepoint:
switched from RUNNING to FAILED on 10.204.2.98:6122-2946e1 @
gsp-tm-0.gsp-headless.gsp.svc.cluster.local (dataPort=41409).
java.lang.Exception: Exception while creating S
Hi,
Could you provide info on the Flink version used?
Cheers,
Gordon
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Savepoint was taken with 1.12.1, I've tried to scale up using same version and
1.12.2
From: Tzu-Li (Gordon) Tai
Sent: Monday, March 15, 2021 12:06 AM
To: user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backen
state backend
Savepoint was taken with 1.12.1, I've tried to scale up using same version and
1.12.2
From: Tzu-Li (Gordon) Tai
Sent: Monday, March 15, 2021 12:06 AM
To: user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB
with RocksDB state backend
Savepoint was taken with 1.12.1, I've tried to scale up using same version and
1.12.2
From: Tzu-Li (Gordon) Tai
Sent: Monday, March 15, 2021 12:06 AM
To: user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job
scale up job with RocksDB state backend
Savepoint was taken with 1.12.1, I've tried to scale up using same version and
1.12.2
From: Tzu-Li (Gordon) Tai
Sent: Monday, March 15, 2021 12:06 AM
To: user@flink.apache.org
Subject: Re: EOFException on attempt to sca
From: Alexey Trenikhun
Sent: Tuesday, March 16, 2021 15:10
To: Yun Tang ; Tzu-Li (Gordon) Tai ;
user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
Also restore from same savepoint without change in parallelism works fine
@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
Hi Yun,
I'm attaching shorter version of log, looks like full version didn't come
through
Thanks,
Alexey
From: Yun Tang
Sent: Tuesday, March 16, 2021
on attempt to scale up job with RocksDB state backend
Attached.
From: Yun Tang
Sent: Tuesday, March 16, 2021 11:13 PM
To: Alexey Trenikhun ; Tzu-Li (Gordon) Tai
; user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state back
, not sure does it have effect on savepoint or not)
Thanks,
Alexey
From: Yun Tang
Sent: Wednesday, March 17, 2021 12:33 AM
To: Alexey Trenikhun ; Tzu-Li (Gordon) Tai
; user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state b
Yun Tang
From: Alexey Trenikhun
Sent: Thursday, March 18, 2021 0:45
To: Yun Tang ; Tzu-Li (Gordon) Tai ;
user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
Hi Yun,
I've copied 77e77928-cb26-4543
ordon) Tai ;
user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
Hi Yun,
Azure web UI shows size of all files created by Flink as 128Mib * X (128, 256,
640), see screenshot attached. In my understanding this is because Flink
creates them as Page Blob
ed in [1] or without
compaction?
Thanks,
Alexey
From: Yun Tang
Sent: Wednesday, March 17, 2021 9:31 PM
To: Alexey Trenikhun ; Tzu-Li (Gordon) Tai
; user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
Hi Alexey,
; Tzu-Li (Gordon) Tai ;
user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
Hi Yun,
How underlying storage explains fact that without re-scale I can restore from
savepoint? Does Flink write file once or many times, if many times, then
potentially
March 18, 2021 5:08 AM
To: Alexey Trenikhun ; Tzu-Li (Gordon) Tai
; user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
Hi Alexey,
Flink would only write once for checkpointed files. Could you try to write
checkpointed files as block blob format
Tang ; Tzu-Li (Gordon) Tai ;
user@flink.apache.org
Subject: Re: EOFException on attempt to scale up job with RocksDB state backend
I Yun,
I've changed configuration to use block blobs, however due to another issue
[1], I can't make savepoint, I hope eventually job will able to proces
16 matches
Mail list logo