What will be the solution for object stores to have fast and correct commit algorithms?
On Wed, Sep 23, 2020 at 11:42 AM Steve Loughran <ste...@cloudera.com.invalid> wrote: > I've got a PR up to completely remove the v2 commit algorithm > > https://github.com/apache/hadoop/pull/2320 > > That may seem overkill, but while *we* know there's a small window of risk > (task attempt 1 failing partway through a nonatomic commit), that's not > known/appreciated by others. > > The patch removes the v2 codepath from FileOutputCommitter, making it a lot > less complicated, and when v2 is requested, a warning is printed and the > option ignored. > > Overkill? Maybe. But it guarantees correctness >
smime.p7s
Description: S/MIME Cryptographic Signature
