bvaradar commented on issue #1825: URL: https://github.com/apache/hudi/issues/1825#issuecomment-663112473
@asheeshgarg : Yes, Hudi only supports single writer.This means you need to be running only one ingestion job at a time. Hudi takes care of running asynchronous background jobs like cleaner, archiving and compaction. Note that Hudi currently mandates single writer in-order to provide row level incremental changelogs. With the next release - 0.6.0, Hudi will allow concurrent ingestion safely as long as users can guarantee that each concurrent ingestion jobs is writing to different physical partitions of the dataset. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
