Re: Savepoint failed with error "Checkpoint expired before completing"

2018-11-19 Thread Gagan Agrawal
-- >>> *From:* Gagan Agrawal >>> *Sent:* Thursday, November 1, 2018 13:38 >>> *To:* myas...@live.com >>> *Cc:* happydexu...@gmail.com; user@flink.apache.org >>> *Subject:* Re: Savepoint failed with error "Checkpoint

Re: Savepoint failed with error "Checkpoint expired before completing"

2018-11-04 Thread Steven Wu
;> posted in dev-mail-list. >> >> Best >> Yun Tang >> -- >> *From:* Gagan Agrawal >> *Sent:* Thursday, November 1, 2018 13:38 >> *To:* myas...@live.com >> *Cc:* happydexu...@gmail.com; user@flink.apache.org >>

Re: Savepoint failed with error "Checkpoint expired before completing"

2018-11-02 Thread Gagan Agrawal
pydexu...@gmail.com; user@flink.apache.org > *Subject:* Re: Savepoint failed with error "Checkpoint expired before > completing" > > Thanks Yun for your inputs. Yes, increasing checkpoint helps and we are > able to save save points now. In our case we wanted to increase pa

Re: Savepoint failed with error "Checkpoint expired before completing"

2018-11-01 Thread Yun Tang
l-list. Best Yun Tang From: Gagan Agrawal Sent: Thursday, November 1, 2018 13:38 To: myas...@live.com Cc: happydexu...@gmail.com; user@flink.apache.org Subject: Re: Savepoint failed with error "Checkpoint expired before completing" Thanks Yun for

Re: Savepoint failed with error "Checkpoint expired before completing"

2018-10-31 Thread Gagan Agrawal
- > *From:* Gagan Agrawal > *Sent:* Wednesday, October 31, 2018 19:03 > *To:* happydexu...@gmail.com > *Cc:* user@flink.apache.org > *Subject:* Re: Savepoint failed with error "Checkpoint expired before > completing" > > Hi Henry, > Than

Re: Savepoint failed with error "Checkpoint expired before completing"

2018-10-31 Thread Yun Tang
he.org Subject: Re: Savepoint failed with error "Checkpoint expired before completing" Hi Henry, Thanks for your response. However we don't face this issue during normal run as we have incremental checkpoints. Only when we try to take savepoint (which tries to save entire state in one g

Re: Savepoint failed with error "Checkpoint expired before completing"

2018-10-31 Thread Gagan Agrawal
Hi Henry, Thanks for your response. However we don't face this issue during normal run as we have incremental checkpoints. Only when we try to take savepoint (which tries to save entire state in one go), we face this problem. Gagan On Wed, Oct 31, 2018 at 11:41 AM 徐涛 wrote: > Hi Gagan, >

Re: Savepoint failed with error "Checkpoint expired before completing"

2018-10-31 Thread 徐涛
Hi Gagan, I have met with the error the checkpoint timeout too. In my case, it is not due to big checkpoint size, but due to slow sink then cause high backpressure to the upper operator. Then the barrier may take a long time to arrive to sink. Please check if it is the

Savepoint failed with error "Checkpoint expired before completing"

2018-10-30 Thread Gagan Agrawal
Hi, We have a flink job (flink version 1.6.1) which unions 2 streams to pass through custom KeyedProcessFunction with RocksDB state store which final creates another stream into Kafka. Current size of checkpoint is around ~100GB and checkpoints are saved to s3 with 5 mins interval and incremental