Dave Hagman created HUDI-2579: --------------------------------- Summary: Deltastreamer checkpoint metadata is not merged from previous commit instant Key: HUDI-2579 URL: https://issues.apache.org/jira/browse/HUDI-2579 Project: Apache Hudi Issue Type: Bug Components: DeltaStreamer, Spark Integration, Writer Core Reporter: Dave Hagman Assignee: Dave Hagman
Non-deltastreamer writers are supposed to copy over checkpoint metadata from previous checkpoints if the config _*hoodie.write.meta.key.prefixes = 'deltastreamer.checkpoint.key'*_ is set. This does not happen which causes non-deltastreamer writers to corrupt the deltastreamer commits by essentially erasing the checkpoint metadata. -- This message was sent by Atlassian Jira (v8.3.4#803005)