Re: RocksDB IO error

2016-11-11 Thread Aljoscha Krettek
Hi Zhenhao, does this happen reproducibly? What happens after the failure? Will it retry restoring and then succeed? I have a suspicion that Yarn could be cleaning up some files that RocksDB expects to be there while restoring. Cheers, Aljoscha On Thu, 10 Nov 2016 at 14:24 wrote: > Hi team, >

RocksDB IO error

2016-11-10 Thread zhenhao.li
Hi team, Could you please investigate on this? It seems that we may face data loss when using RocksDB with enableFullyAsyncSnapshots. It was Flink 1.1.3. Regards, Zhenhao 2016-11-03 13:42:47,071 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph- Source: Custom Source -> (