gianm commented on issue #6963: Tuning Kafka Indexing Service for real time URL: https://github.com/apache/incubator-druid/issues/6963#issuecomment-459205407 If most of your queries are just the last hour of data and you want to get those segments out to the historicals as fast as possible, then, it could potentially make sense. Instead of adjusting segmentGranularity, you might prefer to keep 'hour' for your segmentGranularity, but shorten the taskDuration. Or even keep taskDuration the same, but shorten the intermediateHandoffPeriod. This is because running with mixed segmentGranularities in the same datasource, while supported, can be a headache. Shortening the other two configs just means handoff happens more often. > Read in a few places that windowPeriod is not needed for KIS, if I change the segment duration to 5 min and an event arrives 2 min late, what happens with it? A new segment is created - this is one of the reasons why KIS + compaction = ❤️
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@druid.apache.org For additional commands, e-mail: commits-h...@druid.apache.org
