jinyangli34 opened a new pull request #6092: Add defaultUsed option for druid ingest. URL: https://github.com/apache/incubator-druid/pull/6092 Adding a new ingestion option to allow segments ingested but not replacing the current one. One use case we are using at Airbnb is backfill a datasource with long history segments into multiple small ingestions in parallel. With this option, the production datasource will not be affected during ingestion. Then enable datasource or change mysql metastore after all segments ingestions are done. By default, defaultUsed will be true and behavior the same as today. When defaultUsed is specified as false in ingestion config, after ingestion finish, the segments will not be available until datasource enable get called. To use, add defaultUsed to tuning config: {"tuningConfig": {"defaultUsed": "false"}}}
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
