Hi Zhenhao,
does this happen reproducibly? What happens after the failure? Will it
retry restoring and then succeed?
I have a suspicion that Yarn could be cleaning up some files that RocksDB
expects to be there while restoring.
Cheers,
Aljoscha
On Thu, 10 Nov 2016 at 14:24 wrote:
> Hi team,
>
Hi team,
Could you please investigate on this? It seems that we may face data loss when
using RocksDB with enableFullyAsyncSnapshots.
It was Flink 1.1.3.
Regards,
Zhenhao
2016-11-03 13:42:47,071 INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph- Source: Custom
Source -> (