gaborgsomogyi commented on PR #29422: URL: https://github.com/apache/flink/pull/29422#issuecomment-6194511803
I've just had a deep dive and found the following: @eskabetxe How do you expect `stop-with-savepoint --drain` to help when switching back? My understanding is that drain closes the open files, but the savepoint is still taken before the commit, so the committer state still holds the commit recoverables of the final files, which the Hadoop serializer can't read. Is there a case I'm missing where that state ends up empty? @Samrat002 If my previous statement is right then there is no meaningful way to do any migration between Hadoop and Native connector written operator states. As such we must merge this (after in-depth review) no matter what since now there is no working way for `FileSink` users. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
