bvaradar commented on issue #2229: URL: https://github.com/apache/hudi/issues/2229#issuecomment-722737129
INLINE_COMPACT_NUM_DELTA_COMMITS_PROP configuration controls how many delta commits happen before a compaction is scheduled to be run asynchronously. The normal way folks run ingestion is based on some time interval (deltastreamer/batch write. structured streaming) you have a fixed interval. For example, if you are running ingestion every x mins, you can setup the configuration of INLINE_COMPACT_NUM_DELTA_COMMITS_PROP based on how many x mins there are per day. This is how you can tune the configuration. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
