capistrant commented on PR #19633: URL: https://github.com/apache/druid/pull/19633#issuecomment-4959156954
I still see a downside of triggering a compaction on an interval with such little work to do. could be made less invasive/distruptive if https://github.com/apache/druid/pull/19676 ends up going in. A thought that has crossed my mind is a throttler on these delete only tasks where an `dataSource,interval` pair can only run one such task per day, preventing constant re-compacting intra-day if a datasource is getting sporadic small amounts of data ingested into some interval that has a deletion rule defined over it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
